Next Article in Journal
Analysis of Laser Sensors and Camera Vision in the Shoe Position Inspection System
Next Article in Special Issue
Soft Array Surface-Changing Compound Eye
Previous Article in Journal
Brain MR Image Enhancement for Tumor Segmentation Using 3D U-Net
Previous Article in Special Issue
CACLA-Based Trajectory Tracking Guidance for RLV in Terminal Area Energy Management Phase
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Impact of Attention Mechanisms on Speech Emotion Recognition

School of Mechanical and Electrical Engineering, Guangzhou University, Guangzhou 510006, China
*
Author to whom correspondence should be addressed.
Sensors 2021, 21(22), 7530; https://doi.org/10.3390/s21227530
Submission received: 11 September 2021 / Revised: 1 November 2021 / Accepted: 7 November 2021 / Published: 12 November 2021

Abstract

Speech emotion recognition (SER) plays an important role in real-time applications of human-machine interaction. The Attention Mechanism is widely used to improve the performance of SER. However, the applicable rules of attention mechanism are not deeply discussed. This paper discussed the difference between Global-Attention and Self-Attention and explored their applicable rules to SER classification construction. The experimental results show that the Global-Attention can improve the accuracy of the sequential model, while the Self-Attention can improve the accuracy of the parallel model when conducting the model with the CNN and the LSTM. With this knowledge, a classifier (CNN-LSTM×2+Global-Attention model) for SER is proposed. The experiments result show that it could achieve an accuracy of 85.427% on the EMO-DB dataset.
Keywords: artificial intelligence; speech emotion recognition; attention mechanism; neural networks artificial intelligence; speech emotion recognition; attention mechanism; neural networks

Share and Cite

MDPI and ACS Style

Chen, S.; Zhang, M.; Yang, X.; Zhao, Z.; Zou, T.; Sun, X. The Impact of Attention Mechanisms on Speech Emotion Recognition. Sensors 2021, 21, 7530. https://doi.org/10.3390/s21227530

AMA Style

Chen S, Zhang M, Yang X, Zhao Z, Zou T, Sun X. The Impact of Attention Mechanisms on Speech Emotion Recognition. Sensors. 2021; 21(22):7530. https://doi.org/10.3390/s21227530

Chicago/Turabian Style

Chen, Shouyan, Mingyan Zhang, Xiaofen Yang, Zhijia Zhao, Tao Zou, and Xinqi Sun. 2021. "The Impact of Attention Mechanisms on Speech Emotion Recognition" Sensors 21, no. 22: 7530. https://doi.org/10.3390/s21227530

APA Style

Chen, S., Zhang, M., Yang, X., Zhao, Z., Zou, T., & Sun, X. (2021). The Impact of Attention Mechanisms on Speech Emotion Recognition. Sensors, 21(22), 7530. https://doi.org/10.3390/s21227530

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop