Next Article in Journal
Online Least Squares One-Class Support Vector Machines-Based Abnormal Visual Event Detection
Next Article in Special Issue
Data Mining for Wearable Sensors in Health Monitoring Systems: A Review of Recent Trends and Challenges
Previous Article in Journal
Evaluation of Piecewise Polynomial Equations for Two Types of Thermocouples
Previous Article in Special Issue
Fall Risk Assessment and Early-Warning for Toddler Behaviors at Home
Sensors 2013, 13(12), 17098-17129; doi:10.3390/s131217098

Combined Hand Gesture — Speech Model for Human Action Recognition

*  and
Department of Computer Science and Information Engineering, National Cheng Kung University, No.1, University Road, Tainan City 701, Taiwan
* Author to whom correspondence should be addressed.
Received: 15 October 2013 / Revised: 2 December 2013 / Accepted: 6 December 2013 / Published: 12 December 2013
(This article belongs to the collection Sensors for Globalized Healthy Living and Wellbeing)


This study proposes a dynamic hand gesture detection technology to effectively detect dynamic hand gesture areas, and a hand gesture recognition technology to improve the dynamic hand gesture recognition rate. Meanwhile, the corresponding relationship between state sequences in hand gesture and speech models is considered by integrating speech recognition technology with a multimodal model, thus improving the accuracy of human behavior recognition. The experimental results proved that the proposed method can effectively improve human behavior recognition accuracy and the feasibility of system applications. Experimental results verified that the multimodal gesture-speech model provided superior accuracy when compared to the single modal versions.
Keywords: hand gesture detection; hand gesture recognition; speech recognition; human behavior hand gesture detection; hand gesture recognition; speech recognition; human behavior
This is an open access article distributed under the Creative Commons Attribution License (CC BY) which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Share & Cite This Article

Further Mendeley | CiteULike
Export to BibTeX |
MDPI and ACS Style

Cheng, S.-T.; Hsu, C.-W.; Li, J.-P. Combined Hand Gesture — Speech Model for Human Action Recognition. Sensors 2013, 13, 17098-17129.

View more citation formats

Related Articles

Article Metrics

For more information on the journal, click here


Cited By

[Return to top]
Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert