Next Article in Journal
A Decentralized Framework for Multi-Agent Robotic Systems
Next Article in Special Issue
A Portable Wireless Communication Platform Based on a Multi-Material Fiber Sensor for Real-Time Breath Detection
Previous Article in Journal
A Rotational Gyroscope with a Water-Film Bearing Based on Magnetic Self-Restoring Effect
Article Menu
Issue 2 (February) cover image

Export Article

Open AccessArticle
Sensors 2018, 18(2), 416; https://doi.org/10.3390/s18020416

Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality

EECS Department, The University of Toledo, Toledo, OH 43606, USA
*
Author to whom correspondence should be addressed.
Received: 10 December 2017 / Revised: 23 January 2018 / Accepted: 26 January 2018 / Published: 1 February 2018
(This article belongs to the Special Issue Wearable Smart Devices)
View Full-Text   |   Download PDF [15954 KB, uploaded 1 February 2018]   |  

Abstract

Extensive possibilities of applications have made emotion recognition ineluctable and challenging in the field of computer science. The use of non-verbal cues such as gestures, body movement, and facial expressions convey the feeling and the feedback to the user. This discipline of Human–Computer Interaction places reliance on the algorithmic robustness and the sensitivity of the sensor to ameliorate the recognition. Sensors play a significant role in accurate detection by providing a very high-quality input, hence increasing the efficiency and the reliability of the system. Automatic recognition of human emotions would help in teaching social intelligence in the machines. This paper presents a brief study of the various approaches and the techniques of emotion recognition. The survey covers a succinct review of the databases that are considered as data sets for algorithms detecting the emotions by facial expressions. Later, mixed reality device Microsoft HoloLens (MHL) is introduced for observing emotion recognition in Augmented Reality (AR). A brief introduction of its sensors, their application in emotion recognition and some preliminary results of emotion recognition using MHL are presented. The paper then concludes by comparing results of emotion recognition by the MHL and a regular webcam. View Full-Text
Keywords: facial expressions; emotion recognition; intelligence; augmented reality; affect; Microsoft HoloLens; human–computer interaction; sensors facial expressions; emotion recognition; intelligence; augmented reality; affect; Microsoft HoloLens; human–computer interaction; sensors
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Mehta, D.; Siddiqui, M.F.H.; Javaid, A.Y. Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality. Sensors 2018, 18, 416.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Sensors EISSN 1424-8220 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top