Next Article in Journal
A Rapid Self-Alignment Strategy for a Launch Vehicle on an Offshore Launching Platform
Next Article in Special Issue
Assessment of Different Feature Extraction Methods for Discriminating Expressed Emotions during Music Performance towards BCMI Application
Previous Article in Journal
Propositional Inference for IoT Based Dosage Calibration System Using Private Patient-Specific Prescription against Fatal Dosages
Previous Article in Special Issue
Empathic and Empathetic Systematic Review to Standardize the Development of Reliable and Sustainable Empathic Systems
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 23
Issue 1
10.3390/s23010338
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Wireless Sensing Technology Combined with Facial Expression to Realize Multimodal Emotion Recognition

by
Xiaochao Dang
*,
Zetong Chen
,
Zhanjun Hao
,
Macidan Ga
,
Xinyu Han
,
Xiaotong Zhang
and
Jie Yang
College of Computer Science & Engineering, Northwest Normal University, Lanzhou 730070, China
*
Author to whom correspondence should be addressed.
Sensors 2023, 23(1), 338; https://doi.org/10.3390/s23010338
Submission received: 10 November 2022 / Revised: 8 December 2022 / Accepted: 23 December 2022 / Published: 28 December 2022
(This article belongs to the Special Issue Emotion Recognition in Human-Machine Interaction)
Browse Figures
Review Reports Versions Notes

Abstract

Emotions significantly impact human physical and mental health, and, therefore, emotion recognition has been a popular research area in neuroscience, psychology, and medicine. In this paper, we preprocess the raw signals acquired by millimeter-wave radar to obtain high-quality heartbeat and respiration signals. Then, we propose a deep learning model incorporating a convolutional neural network and gated recurrent unit neural network in combination with human face expression images. The model achieves a recognition accuracy of 84.5% in person-dependent experiments and 74.25% in person-independent experiments. The experiments show that it outperforms a single deep learning model compared to traditional machine learning algorithms.
Keywords: emotion recognition; convolutional neural network; gated recurrent unit; frequency modulated continuous wave; multimodal emotion recognition; convolutional neural network; gated recurrent unit; frequency modulated continuous wave; multimodal

Share and Cite

MDPI and ACS Style

Dang, X.; Chen, Z.; Hao, Z.; Ga, M.; Han, X.; Zhang, X.; Yang, J. Wireless Sensing Technology Combined with Facial Expression to Realize Multimodal Emotion Recognition. Sensors 2023, 23, 338. https://doi.org/10.3390/s23010338

AMA Style

Dang X, Chen Z, Hao Z, Ga M, Han X, Zhang X, Yang J. Wireless Sensing Technology Combined with Facial Expression to Realize Multimodal Emotion Recognition. Sensors. 2023; 23(1):338. https://doi.org/10.3390/s23010338

Chicago/Turabian Style

Dang, Xiaochao, Zetong Chen, Zhanjun Hao, Macidan Ga, Xinyu Han, Xiaotong Zhang, and Jie Yang. 2023. "Wireless Sensing Technology Combined with Facial Expression to Realize Multimodal Emotion Recognition" Sensors 23, no. 1: 338. https://doi.org/10.3390/s23010338

APA Style

Dang, X., Chen, Z., Hao, Z., Ga, M., Han, X., Zhang, X., & Yang, J. (2023). Wireless Sensing Technology Combined with Facial Expression to Realize Multimodal Emotion Recognition. Sensors, 23(1), 338. https://doi.org/10.3390/s23010338

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop