Sensors 2010, 10(4), 2885-2900; doi:10.3390/s100402885
Article

Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach

Received: 28 January 2010; in revised form: 2 March 2010 / Accepted: 14 March 2010 / Published: 29 March 2010
(This article belongs to the Section Physical Sensors)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: To produce a realistic augmentation in Augmented Reality, the correct relative positions of real objects and virtual objects are very important. In this paper, we propose a novel real-time occlusion handling method based on an object tracking approach. Our method is divided into three steps: selection of the occluding object, object tracking and occlusion handling. The user selects the occluding object using an interactive segmentation method. The contour of the selected object is then tracked in the subsequent frames in real-time. In the occlusion handling step, all the pixels on the tracked object are redrawn on the unprocessed augmented image to produce a new synthesized image in which the relative position between the real and virtual object is correct. The proposed method has several advantages. First, it is robust and stable, since it remains effective when the camera is moved through large changes of viewing angles and volumes or when the object and the background have similar colors. Second, it is fast, since the real object can be tracked in real-time. Last, a smoothing technique provides seamless merging between the augmented and virtual object. Several experiments are provided to validate the performance of the proposed method.
Keywords: augmented reality; occlusion; tracking; mean shift; optical flow; graph cuts
PDF Full-text Download PDF Full-Text [435 KB, uploaded 21 June 2014 02:58 CEST]

Export to BibTeX |
EndNote


MDPI and ACS Style

Tian, Y.; Guan, T.; Wang, C. Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach. Sensors 2010, 10, 2885-2900.

AMA Style

Tian Y, Guan T, Wang C. Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach. Sensors. 2010; 10(4):2885-2900.

Chicago/Turabian Style

Tian, Yuan; Guan, Tao; Wang, Cheng. 2010. "Real-Time Occlusion Handling in Augmented Reality Based on an Object Tracking Approach." Sensors 10, no. 4: 2885-2900.

Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert