Sensors 2014, 14(7), 12023-12058; doi:10.3390/s140712023

Robust Arm and Hand Tracking by Unsupervised Context Learning

1,2,* email, 1email and 2email
Received: 4 April 2014; in revised form: 29 June 2014 / Accepted: 1 July 2014 / Published: 7 July 2014
(This article belongs to the Special Issue HCI In Smart Environments)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: Hand tracking in video is an increasingly popular research field due to the rise of novel human-computer interaction methods. However, robust and real-time hand tracking in unconstrained environments remains a challenging task due to the high number of degrees of freedom and the non-rigid character of the human hand. In this paper, we propose an unsupervised method to automatically learn the context in which a hand is embedded. This context includes the arm and any other object that coherently moves along with the hand. We introduce two novel methods to incorporate this context information into a probabilistic tracking framework, and introduce a simple yet effective solution to estimate the position of the arm. Finally, we show that our method greatly increases robustness against occlusion and cluttered background, without degrading tracking performance if no contextual information is available. The proposed real-time algorithm is shown to outperform the current state-of-the-art by evaluating it on three publicly available video datasets. Furthermore, a novel dataset is created and made publicly available for the research community.
Keywords: hand tracking; particle filter; unsupervised learning; random forest; context learning; importance sampling
PDF Full-text Download PDF Full-Text [14175 KB, uploaded 7 July 2014 14:02 CEST]

Export to BibTeX |

MDPI and ACS Style

Spruyt, V.; Ledda, A.; Philips, W. Robust Arm and Hand Tracking by Unsupervised Context Learning. Sensors 2014, 14, 12023-12058.

AMA Style

Spruyt V, Ledda A, Philips W. Robust Arm and Hand Tracking by Unsupervised Context Learning. Sensors. 2014; 14(7):12023-12058.

Chicago/Turabian Style

Spruyt, Vincent; Ledda, Alessandro; Philips, Wilfried. 2014. "Robust Arm and Hand Tracking by Unsupervised Context Learning." Sensors 14, no. 7: 12023-12058.

Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert