Next Article in Journal
Design and Evaluation of a Pervasive Coaching and Gamification Platform for Young Diabetes Patients
Previous Article in Journal
Prototyping a Web-of-Energy Architecture for Smart Integration of Sensor Networks in Smart Grids Domain
Open AccessArticle

A Brief Review of Facial Emotion Recognition Based on Visual Information

Department of Computer Engineering, Keimyung University, Daegu 42601, Korea
Sensors 2018, 18(2), 401; https://doi.org/10.3390/s18020401
Received: 6 December 2017 / Revised: 24 January 2018 / Accepted: 25 January 2018 / Published: 30 January 2018
(This article belongs to the Section Intelligent Sensors)
Facial emotion recognition (FER) is an important topic in the fields of computer vision and artificial intelligence owing to its significant academic and commercial potential. Although FER can be conducted using multiple sensors, this review focuses on studies that exclusively use facial images, because visual expressions are one of the main information channels in interpersonal communication. This paper provides a brief review of researches in the field of FER conducted over the past decades. First, conventional FER approaches are described along with a summary of the representative categories of FER systems and their main algorithms. Deep-learning-based FER approaches using deep networks enabling “end-to-end” learning are then presented. This review also focuses on an up-to-date hybrid deep-learning approach combining a convolutional neural network (CNN) for the spatial features of an individual frame and long short-term memory (LSTM) for temporal features of consecutive frames. In the later part of this paper, a brief review of publicly available evaluation metrics is given, and a comparison with benchmark results, which are a standard for a quantitative comparison of FER researches, is described. This review can serve as a brief guidebook to newcomers in the field of FER, providing basic knowledge and a general understanding of the latest state-of-the-art studies, as well as to experienced researchers looking for productive directions for future work. View Full-Text
Keywords: facial emotion recognition; conventional FER; deep learning-based FER; convolutional neural networks; long short term memory; facial action coding system; facial action unit facial emotion recognition; conventional FER; deep learning-based FER; convolutional neural networks; long short term memory; facial action coding system; facial action unit
Show Figures

Figure 1

MDPI and ACS Style

Ko, B.C. A Brief Review of Facial Emotion Recognition Based on Visual Information. Sensors 2018, 18, 401. https://doi.org/10.3390/s18020401

AMA Style

Ko BC. A Brief Review of Facial Emotion Recognition Based on Visual Information. Sensors. 2018; 18(2):401. https://doi.org/10.3390/s18020401

Chicago/Turabian Style

Ko, Byoung C. 2018. "A Brief Review of Facial Emotion Recognition Based on Visual Information" Sensors 18, no. 2: 401. https://doi.org/10.3390/s18020401

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop