Next Article in Journal
Software Architecture for Mobile Cloud Computing Systems
Previous Article in Journal
Machine Learning-Based Patient Load Prediction and IoT Integrated Intelligent Patient Transfer Systems
Previous Article in Special Issue
An Ontology-Based Recommender System with an Application to the Star Trek Television Franchise
Open AccessArticle

Feature Fusion Text Classification Model Combining CNN and BiGRU with Multi-Attention Mechanism

1
School of Information Science and Engineering, Shandong Normal University, Jinan 250358, China
2
School of Business, Shandong Normal University, Jinan 250358, China
*
Author to whom correspondence should be addressed.
Future Internet 2019, 11(11), 237; https://doi.org/10.3390/fi11110237
Received: 3 September 2019 / Revised: 4 November 2019 / Accepted: 7 November 2019 / Published: 12 November 2019
(This article belongs to the Special Issue New Perspectives on Semantic Web Technologies and Applications)
Convolutional neural networks (CNN) and long short-term memory (LSTM) have gained wide recognition in the field of natural language processing. However, due to the pre- and post-dependence of natural language structure, relying solely on CNN to implement text categorization will ignore the contextual meaning of words and bidirectional long short-term memory (BiLSTM). The feature fusion model is divided into a multiple attention (MATT) CNN model and a bi-directional gated recurrent unit (BiGRU) model. The CNN model inputs the word vector (word vector attention, part of speech attention, position attention) that has been labeled by the attention mechanism into our multi-attention mechanism CNN model. Obtaining the influence intensity of the target keyword on the sentiment polarity of the sentence, and forming the first dimension of the sentiment classification, the BiGRU model replaces the original BiLSTM and extracts the global semantic features of the sentence level to form the second dimension of sentiment classification. Then, using PCA to reduce the dimension of the two-dimensional fusion vector, we finally obtain a classification result combining two dimensions of keywords and sentences. The experimental results show that the proposed MATT-CNN+BiGRU fusion model has 5.94% and 11.01% higher classification accuracy on the MRD and SemEval2016 datasets, respectively, than the mainstream CNN+BiLSTM method. View Full-Text
Keywords: BiGRU; multi-attention; MATT-CNN+BiGRU; PCA BiGRU; multi-attention; MATT-CNN+BiGRU; PCA
Show Figures

Figure 1

MDPI and ACS Style

Zhang, J.; Liu, F.; Xu, W.; Yu, H. Feature Fusion Text Classification Model Combining CNN and BiGRU with Multi-Attention Mechanism. Future Internet 2019, 11, 237.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop