Next Article in Journal
No Perfect Outdoors: Towards a Deep Profiling of GNSS-Based Location Contexts
Next Article in Special Issue
Predicting Dog Emotions Based on Posture Analysis Using DeepLabCut
Previous Article in Journal
Authorship Attribution of Social Media and Literary Russian-Language Texts Using Machine Learning Methods and Feature Selection
Previous Article in Special Issue
A Secure and Efficient Multi-Factor Authentication Algorithm for Mobile Money Applications
Article

Your Face Mirrors Your Deepest Beliefs—Predicting Personality and Morals through Facial Emotion Recognition

1
MIT Center for Collective Intelligence, Cambridge, MA 02142, USA
2
Department of Engineering, University of Perugia, 06123 Perugia, Italy
3
Galaxyadvisors AG, 5000 Aarau, Switzerland
4
Department of Data Science, Lucerne University of Applied Sciences and Arts, 6002 Lucerne, Switzerland
5
Department of Information Systems, University of Cologne, 50923 Cologne, Germany
*
Author to whom correspondence should be addressed.
Academic Editors: Kaushik Roy, Mustafa Atay and Ajita Rattani
Future Internet 2022, 14(1), 5; https://doi.org/10.3390/fi14010005
Received: 30 November 2021 / Revised: 20 December 2021 / Accepted: 22 December 2021 / Published: 22 December 2021
(This article belongs to the Collection Machine Learning Approaches for User Identity)
Can we really “read the mind in the eyes”? Moreover, can AI assist us in this task? This paper answers these two questions by introducing a machine learning system that predicts personality characteristics of individuals on the basis of their face. It does so by tracking the emotional response of the individual’s face through facial emotion recognition (FER) while watching a series of 15 short videos of different genres. To calibrate the system, we invited 85 people to watch the videos, while their emotional responses were analyzed through their facial expression. At the same time, these individuals also took four well-validated surveys of personality characteristics and moral values: the revised NEO FFI personality inventory, the Haidt moral foundations test, the Schwartz personal value system, and the domain-specific risk-taking scale (DOSPERT). We found that personality characteristics and moral values of an individual can be predicted through their emotional response to the videos as shown in their face, with an accuracy of up to 86% using gradient-boosted trees. We also found that different personality characteristics are better predicted by different videos, in other words, there is no single video that will provide accurate predictions for all personality characteristics, but it is the response to the mix of different videos that allows for accurate prediction. View Full-Text
Keywords: artificial intelligence; facial emotion recognition; personality; moral values; risk-taking; forecasting artificial intelligence; facial emotion recognition; personality; moral values; risk-taking; forecasting
Show Figures

Figure 1

MDPI and ACS Style

Gloor, P.A.; Fronzetti Colladon, A.; Altuntas, E.; Cetinkaya, C.; Kaiser, M.F.; Ripperger, L.; Schaefer, T. Your Face Mirrors Your Deepest Beliefs—Predicting Personality and Morals through Facial Emotion Recognition. Future Internet 2022, 14, 5. https://doi.org/10.3390/fi14010005

AMA Style

Gloor PA, Fronzetti Colladon A, Altuntas E, Cetinkaya C, Kaiser MF, Ripperger L, Schaefer T. Your Face Mirrors Your Deepest Beliefs—Predicting Personality and Morals through Facial Emotion Recognition. Future Internet. 2022; 14(1):5. https://doi.org/10.3390/fi14010005

Chicago/Turabian Style

Gloor, Peter A., Andrea Fronzetti Colladon, Erkin Altuntas, Cengiz Cetinkaya, Maximilian F. Kaiser, Lukas Ripperger, and Tim Schaefer. 2022. "Your Face Mirrors Your Deepest Beliefs—Predicting Personality and Morals through Facial Emotion Recognition" Future Internet 14, no. 1: 5. https://doi.org/10.3390/fi14010005

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop