Sensors 2010, 10(4), 2885-2900; doi:10.3390/s100402885
Article

Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach

Digital Engineering & Simulation Research Center, Huazhong University of Science and Technology, Wuhan 430074, China
* Author to whom correspondence should be addressed.
Received: 28 January 2010; in revised form: 2 March 2010 / Accepted: 14 March 2010 / Published: 29 March 2010
(This article belongs to the Section Physical Sensors)
PDF Full-text Download PDF Full-Text [435 KB, uploaded 29 March 2010 16:04 CEST]
Abstract: To produce a realistic augmentation in Augmented Reality, the correct relative positions of real objects and virtual objects are very important. In this paper, we propose a novel real-time occlusion handling method based on an object tracking approach. Our method is divided into three steps: selection of the occluding object, object tracking and occlusion handling. The user selects the occluding object using an interactive segmentation method. The contour of the selected object is then tracked in the subsequent frames in real-time. In the occlusion handling step, all the pixels on the tracked object are redrawn on the unprocessed augmented image to produce a new synthesized image in which the relative position between the real and virtual object is correct. The proposed method has several advantages. First, it is robust and stable, since it remains effective when the camera is moved through large changes of viewing angles and volumes or when the object and the background have similar colors. Second, it is fast, since the real object can be tracked in real-time. Last, a smoothing technique provides seamless merging between the augmented and virtual object. Several experiments are provided to validate the performance of the proposed method.
Keywords: augmented reality; occlusion; tracking; mean shift; optical flow; graph cuts

Article Statistics

Load and display the download statistics.

Citations to this Article

Cite This Article

MDPI and ACS Style

Tian, Y.; Guan, T.; Wang, C. Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach. Sensors 2010, 10, 2885-2900.

AMA Style

Tian Y, Guan T, Wang C. Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach. Sensors. 2010; 10(4):2885-2900.

Chicago/Turabian Style

Tian, Yuan; Guan, Tao; Wang, Cheng. 2010. "Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach." Sensors 10, no. 4: 2885-2900.

Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert