Open AccessThis article is
- freely available
Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach
Digital Engineering & Simulation Research Center, Huazhong University of Science and Technology, Wuhan 430074, China
* Author to whom correspondence should be addressed.
Received: 28 January 2010; in revised form: 2 March 2010 / Accepted: 14 March 2010 / Published: 29 March 2010
Abstract: To produce a realistic augmentation in Augmented Reality, the correct relative positions of real objects and virtual objects are very important. In this paper, we propose a novel real-time occlusion handling method based on an object tracking approach. Our method is divided into three steps: selection of the occluding object, object tracking and occlusion handling. The user selects the occluding object using an interactive segmentation method. The contour of the selected object is then tracked in the subsequent frames in real-time. In the occlusion handling step, all the pixels on the tracked object are redrawn on the unprocessed augmented image to produce a new synthesized image in which the relative position between the real and virtual object is correct. The proposed method has several advantages. First, it is robust and stable, since it remains effective when the camera is moved through large changes of viewing angles and volumes or when the object and the background have similar colors. Second, it is fast, since the real object can be tracked in real-time. Last, a smoothing technique provides seamless merging between the augmented and virtual object. Several experiments are provided to validate the performance of the proposed method.
Keywords: augmented reality; occlusion; tracking; mean shift; optical flow; graph cuts
Citations to this Article
Cite This Article
MDPI and ACS Style
Tian, Y.; Guan, T.; Wang, C. Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach. Sensors 2010, 10, 2885-2900.
Tian Y, Guan T, Wang C. Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach. Sensors. 2010; 10(4):2885-2900.
Tian, Yuan; Guan, Tao; Wang, Cheng. 2010. "Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach." Sensors 10, no. 4: 2885-2900.