Next Article in Journal
Accelerating Density Peak Clustering Algorithm
Previous Article in Journal
3D Flow Entropy Contour Fitting Segmentation Algorithm Based on Multi-Scale Transform Contour Constraint
Previous Article in Special Issue
Symmetry in Engineering Sciences
Open AccessArticle

Feature Selection with Conditional Mutual Information Considering Feature Interaction

1
State Key Lab of Nuclear Power Safety Monitoring Technology and Equipment, Shenzhen 518124, China
2
State Key Lab of Industrial Control Technology, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China
*
Author to whom correspondence should be addressed.
Symmetry 2019, 11(7), 858; https://doi.org/10.3390/sym11070858
Received: 30 May 2019 / Revised: 24 June 2019 / Accepted: 25 June 2019 / Published: 2 July 2019
(This article belongs to the Special Issue Symmetry in Engineering Sciences)
  |  
PDF [1053 KB, uploaded 10 July 2019]
  |  

Abstract

Feature interaction is a newly proposed feature relevance relationship, but the unintentional removal of interactive features can result in poor classification performance for this relationship. However, traditional feature selection algorithms mainly focus on detecting relevant and redundant features while interactive features are usually ignored. To deal with this problem, feature relevance, feature redundancy and feature interaction are redefined based on information theory. Then a new feature selection algorithm named CMIFSI (Conditional Mutual Information based Feature Selection considering Interaction) is proposed in this paper, which makes use of conditional mutual information to estimate feature redundancy and interaction, respectively. To verify the effectiveness of our algorithm, empirical experiments are conducted to compare it with other several representative feature selection algorithms. The results on both synthetic and benchmark datasets indicate that our algorithm achieves better results than other methods in most cases. Further, it highlights the necessity of dealing with feature interaction. View Full-Text
Keywords: feature selection; conditional mutual information; feature interaction; classification; computer engineering feature selection; conditional mutual information; feature interaction; classification; computer engineering
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Liang, J.; Hou, L.; Luan, Z.; Huang, W. Feature Selection with Conditional Mutual Information Considering Feature Interaction. Symmetry 2019, 11, 858.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Symmetry EISSN 2073-8994 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top