Next Article in Journal
Expected Income of New Currency in Blockchain Based on Data-Mining Technology
Previous Article in Journal
An Urban Autodriving Algorithm Based on a Sensor-Weighted Integration Field with Deep Learning
Open AccessFeature PaperArticle

Computer Vision Intelligent Approaches to Extract Human Pose and Its Activity from Image Sequences

1
IDMEC, Instituto Politécnico de Castelo Branco, Av Empresário, 6000-767 Castelo branco, Portugal
2
IMT Mines Alès, 6 Avenue de Clavières, 30100 Alès, France
*
Author to whom correspondence should be addressed.
Electronics 2020, 9(1), 159; https://doi.org/10.3390/electronics9010159
Received: 13 December 2019 / Revised: 9 January 2020 / Accepted: 11 January 2020 / Published: 15 January 2020
(This article belongs to the Section Artificial Intelligence)
The purpose of this work is to develop computational intelligence models based on neural networks (NN), fuzzy models (FM), support vector machines (SVM) and long short-term memory networks (LSTM) to predict human pose and activity from image sequences, based on computer vision approaches to gather the required features. To obtain the human pose semantics (output classes), based on a set of 3D points that describe the human body model (the input variables of the predictive model), prediction models were obtained from the acquired data, for example, video images. In the same way, to predict the semantics of the atomic activities that compose an activity, based again in the human body model extracted at each video frame, prediction models were learned using LSTM networks. In both cases the best learned models were implemented in an application to test the systems. The SVM model obtained 95.97% of correct classification of the six different human poses tackled in this work, during tests in different situations from the training phase. The implemented LSTM learned model achieved an overall accuracy of 88%, during tests in different situations from the training phase. These results demonstrate the validity of both approaches to predict human pose and activity from image sequences. Moreover, the system is capable of obtaining the atomic activities and quantifying the time interval in which each activity takes place. View Full-Text
Keywords: computer vision; human pose estimation; human activity estimation; deep learning; neural network; fuzzy modelling; support vector machines computer vision; human pose estimation; human activity estimation; deep learning; neural network; fuzzy modelling; support vector machines
Show Figures

Figure 1

MDPI and ACS Style

Gonçalves, P.J.S.; Lourenço, B.; Santos, S.; Barlogis, R.; Misson, A. Computer Vision Intelligent Approaches to Extract Human Pose and Its Activity from Image Sequences. Electronics 2020, 9, 159.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop