Method of Feature Reduction in Short Text Classification Based on Feature Clustering
AbstractOne decisive problem of short text classification is the serious dimensional disaster when utilizing a statistics-based approach to construct vector spaces. Here, a feature reduction method is proposed that is based on two-stage feature clustering (TSFC), which is applied to short text classification. Features are semi-loosely clustered by combining spectral clustering with a graph traversal algorithm. Next, intra-cluster feature screening rules are designed to remove outlier feature words, which improves the effect of similar feature clusters. We classify short texts with corresponding similar feature clusters instead of original feature words. Similar feature clusters replace feature words, and the dimension of vector space is significantly reduced. Several classifiers are utilized to evaluate the effectiveness of this method. The results show that the method largely resolves the dimensional disaster and it can significantly improve the accuracy of short text classification.
Share & Cite This Article
Li, F.; Yin, Y.; Shi, J.; Mao, X.; Shi, R. Method of Feature Reduction in Short Text Classification Based on Feature Clustering. Appl. Sci. 2019, 9, 1578.
Li F, Yin Y, Shi J, Mao X, Shi R. Method of Feature Reduction in Short Text Classification Based on Feature Clustering. Applied Sciences. 2019; 9(8):1578.Chicago/Turabian Style
Li, Fangfang; Yin, Yao; Shi, Jinjing; Mao, Xingliang; Shi, and Ronghua. 2019. "Method of Feature Reduction in Short Text Classification Based on Feature Clustering." Appl. Sci. 9, no. 8: 1578.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.