Next Article in Journal
Research on the Open-Categorical Classification of the Internet-of-Things Based on Generative Adversarial Networks
Next Article in Special Issue
Tongue–Computer Interface Prototype Design Based on T-Type Magnet Localization for Smart Environment Control
Previous Article in Journal
Passive Detection of Low-Altitude Signal Sources Using an Improved Cross-Correlation Algorithm
Previous Article in Special Issue
Design and Implementation of a Smart IoT Based Building and Town Disaster Management System in Smart City Infrastructure
Open AccessArticle

A Novel Gesture Recognition System for Intelligent Interaction with a Nursing-Care Assistant Robot

1
State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China
2
Department of Mechanical Engineering, Northwestern University, Evanston, IL 60201, USA
3
ABB Corporate Research Sweden, 72178 Vasteras, Sweden
*
Author to whom correspondence should be addressed.
Appl. Sci. 2018, 8(12), 2349; https://doi.org/10.3390/app8122349
Received: 20 September 2018 / Revised: 17 November 2018 / Accepted: 19 November 2018 / Published: 22 November 2018
(This article belongs to the Special Issue Advanced Internet of Things for Smart Infrastructure System)
The expansion of nursing-care assistant robots in smart infrastructure has provided more applications for homecare services, which has raised new demands for smart and natural interaction between humans and robots. This article proposed an innovative hand motion trajectory (HMT) gesture recognition system based on background velocity features. Here, a new wearable wrist-worn camera prototype for gesture’s video collection was designed, and a new method for the segmentation of continuous gestures was shown. Meanwhile, a nursing-care assistant robot prototype was designed for assisting the elderly, which is capable of carrying the elderly with omnidirectional motion and grabbing the specified object at home. In order to evaluate the performance of the gesture recognition system, 10 special gestures were defined as the move commands for interaction with the robot, and 1000 HMT gesture samples were obtained from five subjects for leave-one-subject-out (LOSO) cross-validation classification with an average recognition accuracy of up to 97.34%. Moreover, the performance and practicability of the proposed system were further demonstrated by controlling the omnidirectional movement of the nursing-care assistant robot using the predefined gesture commands. View Full-Text
Keywords: HMT gesture recognition; smart infrastructure; nursing-care assistant robot; wearable wrist-worn camera; continuous gesture segmentation; human–robot interaction HMT gesture recognition; smart infrastructure; nursing-care assistant robot; wearable wrist-worn camera; continuous gesture segmentation; human–robot interaction
Show Figures

Figure 1

MDPI and ACS Style

Yang, G.; Lv, H.; Chen, F.; Pang, Z.; Wang, J.; Yang, H.; Zhang, J. A Novel Gesture Recognition System for Intelligent Interaction with a Nursing-Care Assistant Robot. Appl. Sci. 2018, 8, 2349.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop