Next Article in Journal
Measurement Accuracy Enhancement via Radio Frequency Filtering in Distributed Brillouin Sensing
Next Article in Special Issue
Predicting Depression, Anxiety, and Stress Levels from Videos Using the Facial Action Coding System
Previous Article in Journal
A Review of Methods for Fibre-Optic Distributed Chemical Sensing
Previous Article in Special Issue
Predicting Group Contribution Behaviour in a Public Goods Game from Face-to-Face Communication
Open AccessArticle

Game-Calibrated and User-Tailored Remote Detection of Stress and Boredom in Games

1
Computer Science, Federal University of Fronteira Sul, Chapecó 89802 112, Brazil
2
School of Informatics, University of Skövde, 541 28 Skövde, Sweden
*
Author to whom correspondence should be addressed.
Sensors 2019, 19(13), 2877; https://doi.org/10.3390/s19132877
Received: 28 May 2019 / Revised: 21 June 2019 / Accepted: 25 June 2019 / Published: 28 June 2019
(This article belongs to the Special Issue Sensors for Affective Computing and Sentiment Analysis)
Emotion detection based on computer vision and remote extraction of user signals commonly rely on stimuli where users have a passive role with limited possibilities for interaction or emotional involvement, e.g., images and videos. Predictive models are also trained on a group level, which potentially excludes or dilutes key individualities of users. We present a non-obtrusive, multifactorial, user-tailored emotion detection method based on remotely estimated psychophysiological signals. A neural network learns the emotional profile of a user during the interaction with calibration games, a novel game-based emotion elicitation material designed to induce emotions while accounting for particularities of individuals. We evaluate our method in two experiments ( n = 20 and n = 62 ) with mean classification accuracy of 61.6%, which is statistically significantly better than chance-level classification. Our approach and its evaluation present unique circumstances: our model is trained on one dataset (calibration games) and tested on another (evaluation game), while preserving the natural behavior of subjects and using remote acquisition of signals. Results of this study suggest our method is feasible and an initiative to move away from questionnaires and physical sensors into a non-obtrusive, remote-based solution for detecting emotions in a context involving more naturalistic user behavior and games. View Full-Text
Keywords: human–computer interaction; games; affective computing; remote photoplethysmography human–computer interaction; games; affective computing; remote photoplethysmography
Show Figures

Figure 1

MDPI and ACS Style

Bevilacqua, F.; Engström, H.; Backlund, P. Game-Calibrated and User-Tailored Remote Detection of Stress and Boredom in Games. Sensors 2019, 19, 2877.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map

1
Back to TopTop