Next Article in Journal
Cooperative Search Method for Multiple UAVs Based on Deep Reinforcement Learning
Previous Article in Journal
Research on Lane Changing Game and Behavioral Decision Making Based on Driving Styles and Micro-Interaction Behaviors
Previous Article in Special Issue
EEG Emotion Classification Network Based on Attention Fusion of Multi-Channel Band Features
 
 
Article

Recognition of Emotion by Brain Connectivity and Eye Movement

by 1,†, 1,†, 1 and 2,*
1
Department of Emotion Engineering, Sangmyung University, Seoul 03016, Korea
2
Department of Human-Centered Artificial Intelligence, Sangmyung University, Seoul 03016, Korea
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Academic Editor: Wataru Sato
Sensors 2022, 22(18), 6736; https://doi.org/10.3390/s22186736
Received: 19 July 2022 / Revised: 22 August 2022 / Accepted: 3 September 2022 / Published: 6 September 2022
(This article belongs to the Special Issue Emotion Intelligence Based on Smart Sensing)
Simultaneous activation of brain regions (i.e., brain connection features) is an essential mechanism of brain activity in emotion recognition of visual content. The occipital cortex of the brain is involved in visual processing, but the frontal lobe processes cranial nerve signals to control higher emotions. However, recognition of emotion in visual content merits the analysis of eye movement features, because the pupils, iris, and other eye structures are connected to the nerves of the brain. We hypothesized that when viewing video content, the activation features of brain connections are significantly related to eye movement characteristics. We investigated the relationship between brain connectivity (strength and directionality) and eye movement features (left and right pupils, saccades, and fixations) when 47 participants viewed an emotion-eliciting video on a two-dimensional emotion model (valence and arousal). We found that the connectivity eigenvalues of the long-distance prefrontal lobe, temporal lobe, parietal lobe, and center are related to cognitive activity involving high valance. In addition, saccade movement was correlated with long-distance occipital-frontal connectivity. Finally, short-distance connectivity results showed emotional fluctuations caused by unconscious stimulation. View Full-Text
Keywords: emotion recognition; attention; eye movement; brain connectivity emotion recognition; attention; eye movement; brain connectivity
Show Figures

Figure 1

MDPI and ACS Style

Zhang, J.; Park, S.; Cho, A.; Whang, M. Recognition of Emotion by Brain Connectivity and Eye Movement. Sensors 2022, 22, 6736. https://doi.org/10.3390/s22186736

AMA Style

Zhang J, Park S, Cho A, Whang M. Recognition of Emotion by Brain Connectivity and Eye Movement. Sensors. 2022; 22(18):6736. https://doi.org/10.3390/s22186736

Chicago/Turabian Style

Zhang, Jing, Sung Park, Ayoung Cho, and Mincheol Whang. 2022. "Recognition of Emotion by Brain Connectivity and Eye Movement" Sensors 22, no. 18: 6736. https://doi.org/10.3390/s22186736

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop