Sensors 2013, 13(12), 17098-17129; doi:10.3390/s131217098

Combined Hand Gesture — Speech Model for Human Action Recognition

email, * email and email
Received: 15 October 2013; in revised form: 2 December 2013 / Accepted: 6 December 2013 / Published: 12 December 2013
(This article belongs to the collection Sensors for Globalized Healthy Living and Wellbeing)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: This study proposes a dynamic hand gesture detection technology to effectively detect dynamic hand gesture areas, and a hand gesture recognition technology to improve the dynamic hand gesture recognition rate. Meanwhile, the corresponding relationship between state sequences in hand gesture and speech models is considered by integrating speech recognition technology with a multimodal model, thus improving the accuracy of human behavior recognition. The experimental results proved that the proposed method can effectively improve human behavior recognition accuracy and the feasibility of system applications. Experimental results verified that the multimodal gesture-speech model provided superior accuracy when compared to the single modal versions.
Keywords: hand gesture detection; hand gesture recognition; speech recognition; human behavior
PDF Full-text Download PDF Full-Text [2111 KB, uploaded 21 June 2014 10:51 CEST]

Export to BibTeX |

MDPI and ACS Style

Cheng, S.-T.; Hsu, C.-W.; Li, J.-P. Combined Hand Gesture — Speech Model for Human Action Recognition. Sensors 2013, 13, 17098-17129.

AMA Style

Cheng S-T, Hsu C-W, Li J-P. Combined Hand Gesture — Speech Model for Human Action Recognition. Sensors. 2013; 13(12):17098-17129.

Chicago/Turabian Style

Cheng, Sheng-Tzong; Hsu, Chih-Wei; Li, Jian-Pan. 2013. "Combined Hand Gesture — Speech Model for Human Action Recognition." Sensors 13, no. 12: 17098-17129.

Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert