Next Article in Journal
Online Least Squares One-Class Support Vector Machines-Based Abnormal Visual Event Detection
Next Article in Special Issue
Data Mining for Wearable Sensors in Health Monitoring Systems: A Review of Recent Trends and Challenges
Previous Article in Journal
Evaluation of Piecewise Polynomial Equations for Two Types of Thermocouples
Previous Article in Special Issue
Fall Risk Assessment and Early-Warning for Toddler Behaviors at Home
Article Menu

Export Article

Open AccessArticle
Sensors 2013, 13(12), 17098-17129; doi:10.3390/s131217098

Combined Hand Gesture — Speech Model for Human Action Recognition

Department of Computer Science and Information Engineering, National Cheng Kung University, No.1, University Road, Tainan City 701, Taiwan
Author to whom correspondence should be addressed.
Received: 15 October 2013 / Revised: 2 December 2013 / Accepted: 6 December 2013 / Published: 12 December 2013
(This article belongs to the Collection Sensors for Globalized Healthy Living and Wellbeing)


This study proposes a dynamic hand gesture detection technology to effectively detect dynamic hand gesture areas, and a hand gesture recognition technology to improve the dynamic hand gesture recognition rate. Meanwhile, the corresponding relationship between state sequences in hand gesture and speech models is considered by integrating speech recognition technology with a multimodal model, thus improving the accuracy of human behavior recognition. The experimental results proved that the proposed method can effectively improve human behavior recognition accuracy and the feasibility of system applications. Experimental results verified that the multimodal gesture-speech model provided superior accuracy when compared to the single modal versions.
Keywords: hand gesture detection; hand gesture recognition; speech recognition; human behavior hand gesture detection; hand gesture recognition; speech recognition; human behavior
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Cheng, S.-T.; Hsu, C.-W.; Li, J.-P. Combined Hand Gesture — Speech Model for Human Action Recognition. Sensors 2013, 13, 17098-17129.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top