Next Article in Journal
Diagnosis of the Severity of Fusarium Head Blight of Wheat Ears on the Basis of Image and Spectral Feature Fusion
Previous Article in Journal
Investigation of the Impact of Infrared Sensors on Core Body Temperature Monitoring by Comparing Measurement Sites
Open AccessArticle

Real-Time Human Action Recognition with a Low-Cost RGB Camera and Mobile Robot Platform

by Junwoo Lee 1 and Bummo Ahn 1,2,*
1
Robotics Group, Korea Institute of Industrial Technology, Ansan 15588, Korea
2
Robotics & Virtual Engineering, KITECH Campus, Ansan 15588, Korea
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(10), 2886; https://doi.org/10.3390/s20102886
Received: 31 March 2020 / Revised: 8 May 2020 / Accepted: 13 May 2020 / Published: 19 May 2020
(This article belongs to the Section Intelligent Sensors)
Human action recognition is an important research area in the field of computer vision that can be applied in surveillance, assisted living, and robotic systems interacting with people. Although various approaches have been widely used, recent studies have mainly focused on deep-learning networks using Kinect camera that can easily generate data on skeleton joints using depth data, and have achieved satisfactory performances. However, their models are deep and complex to achieve a higher recognition score; therefore, they cannot be applied to a mobile robot platform using a Kinect camera. To overcome these limitations, we suggest a method to classify human actions in real-time using a single RGB camera, which can be applied to the mobile robot platform as well. We integrated two open-source libraries, i.e., OpenPose and 3D-baseline, to extract skeleton joints on RGB images, and classified the actions using convolutional neural networks. Finally, we set up the mobile robot platform including an NVIDIA JETSON XAVIER embedded board and tracking algorithm to monitor a person continuously. We achieved an accuracy of 70% on the NTU-RGBD training dataset, and the whole process was performed on an average of 15 frames per second (FPS) on an embedded board system. View Full-Text
Keywords: real-time; human action recognition; mobile robot; embedded board; RGB camera real-time; human action recognition; mobile robot; embedded board; RGB camera
Show Figures

Figure 1

MDPI and ACS Style

Lee, J.; Ahn, B. Real-Time Human Action Recognition with a Low-Cost RGB Camera and Mobile Robot Platform. Sensors 2020, 20, 2886.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop