Next Article in Journal
Interventionism in Statistical Mechanics
Previous Article in Journal
Classical and Quantum Models in Non-Equilibrium Statistical Mechanics: Moment Methods and Long-Time Approximations
Entropy 2012, 14(2), 323-343; doi:10.3390/e14020323

Filter-Type Variable Selection Based on Information Measures for Regression Tasks

* ,
Institute of New Imaging Technologies, Universidad Jaume I, Campus del Riu Sec, s/n, 12071 Castellón de la Plana, Spain
* Author to whom correspondence should be addressed.
Received: 8 December 2011 / Revised: 9 February 2012 / Accepted: 12 February 2012 / Published: 17 February 2012
View Full-Text   |   Download PDF [296 KB, uploaded 24 February 2015]   |  


This paper presents a supervised variable selection method applied to regression problems. This method selects the variables applying a hierarchical clustering strategy based on information measures. The proposed technique can be applied to single-output regression datasets, and it is extendable to multi-output datasets. For single-output datasets, the method is compared against three other variable selection methods for regression on four datasets. In the multi-output case, it is compared against other state-of-the-art method and tested using two regression datasets. Two different figures of merit are used (for the single and multi-output cases) in order to analyze and compare the performance of the proposed method.
Keywords: variable selection; conditional mutual information variable selection; conditional mutual information
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Share & Cite This Article

Further Mendeley | CiteULike
Export to BibTeX |
EndNote |
MDPI and ACS Style

Latorre Carmona, P.; Sotoca, J.M.; Pla, F. Filter-Type Variable Selection Based on Information Measures for Regression Tasks. Entropy 2012, 14, 323-343.

View more citation formats

Related Articles

Article Metrics

For more information on the journal, click here


[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert