Sensors 2013, 13(12), 17098-17129; doi:10.3390/s131217098
Article

Combined Hand Gesture — Speech Model for Human Action Recognition

Department of Computer Science and Information Engineering, National Cheng Kung University, No.1, University Road, Tainan City 701, Taiwan
* Author to whom correspondence should be addressed.
Received: 15 October 2013; in revised form: 2 December 2013 / Accepted: 6 December 2013 / Published: 12 December 2013
(This article belongs to the Special Issue Sensors for Globalized Healthy Living and Wellbeing)
PDF Full-text Download PDF Full-Text [2111 KB, uploaded 12 December 2013 10:08 CET]
Abstract: This study proposes a dynamic hand gesture detection technology to effectively detect dynamic hand gesture areas, and a hand gesture recognition technology to improve the dynamic hand gesture recognition rate. Meanwhile, the corresponding relationship between state sequences in hand gesture and speech models is considered by integrating speech recognition technology with a multimodal model, thus improving the accuracy of human behavior recognition. The experimental results proved that the proposed method can effectively improve human behavior recognition accuracy and the feasibility of system applications. Experimental results verified that the multimodal gesture-speech model provided superior accuracy when compared to the single modal versions.
Keywords: hand gesture detection; hand gesture recognition; speech recognition; human behavior

Article Statistics

Load and display the download statistics.

Citations to this Article

Cite This Article

MDPI and ACS Style

Cheng, S.-T.; Hsu, C.-W.; Li, J.-P. Combined Hand Gesture — Speech Model for Human Action Recognition. Sensors 2013, 13, 17098-17129.

AMA Style

Cheng S-T, Hsu C-W, Li J-P. Combined Hand Gesture — Speech Model for Human Action Recognition. Sensors. 2013; 13(12):17098-17129.

Chicago/Turabian Style

Cheng, Sheng-Tzong; Hsu, Chih-Wei; Li, Jian-Pan. 2013. "Combined Hand Gesture — Speech Model for Human Action Recognition." Sensors 13, no. 12: 17098-17129.

Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert