Next Article in Journal
Are People with Aphasia (PWA) Involved in the Creation of Quality of Life and Aphasia Impact-Related Questionnaires? A Scoping Review
Next Article in Special Issue
Lightweight Building of an Electroencephalogram-Based Emotion Detection System
Previous Article in Journal
Comparison of Modern Highly Interactive Flicker-Free Steady State Motion Visual Evoked Potentials for Practical Brain–Computer Interfaces
Previous Article in Special Issue
An Emotion Assessment of Stroke Patients by Using Bispectrum Features of EEG Signals
Review

Advances in Multimodal Emotion Recognition Based on Brain–Computer Interfaces

1
School of Software, South China Normal University, Foshan 528225, China
2
School of Computer, South China Normal University, Guangzhou 510641, China
*
Author to whom correspondence should be addressed.
Brain Sci. 2020, 10(10), 687; https://doi.org/10.3390/brainsci10100687
Received: 20 August 2020 / Revised: 19 September 2020 / Accepted: 26 September 2020 / Published: 29 September 2020
With the continuous development of portable noninvasive human sensor technologies such as brain–computer interfaces (BCI), multimodal emotion recognition has attracted increasing attention in the area of affective computing. This paper primarily discusses the progress of research into multimodal emotion recognition based on BCI and reviews three types of multimodal affective BCI (aBCI): aBCI based on a combination of behavior and brain signals, aBCI based on various hybrid neurophysiology modalities and aBCI based on heterogeneous sensory stimuli. For each type of aBCI, we further review several representative multimodal aBCI systems, including their design principles, paradigms, algorithms, experimental results and corresponding advantages. Finally, we identify several important issues and research directions for multimodal emotion recognition based on BCI. View Full-Text
Keywords: emotion recognition; multimodal fusion; brain–computer interface (BCI); affective computing emotion recognition; multimodal fusion; brain–computer interface (BCI); affective computing
Show Figures

Figure 1

MDPI and ACS Style

He, Z.; Li, Z.; Yang, F.; Wang, L.; Li, J.; Zhou, C.; Pan, J. Advances in Multimodal Emotion Recognition Based on Brain–Computer Interfaces. Brain Sci. 2020, 10, 687. https://doi.org/10.3390/brainsci10100687

AMA Style

He Z, Li Z, Yang F, Wang L, Li J, Zhou C, Pan J. Advances in Multimodal Emotion Recognition Based on Brain–Computer Interfaces. Brain Sciences. 2020; 10(10):687. https://doi.org/10.3390/brainsci10100687

Chicago/Turabian Style

He, Zhipeng, Zina Li, Fuzhou Yang, Lei Wang, Jingcong Li, Chengju Zhou, and Jiahui Pan. 2020. "Advances in Multimodal Emotion Recognition Based on Brain–Computer Interfaces" Brain Sciences 10, no. 10: 687. https://doi.org/10.3390/brainsci10100687

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop