Skip to Content
You are currently on the new version of our website. Access the old version .

30,146 Results Found

  • Proceeding Paper
  • Open Access
2 Citations
2,088 Views
3 Pages

In a world that is highly saturated by data, sifting it and making sense of it has become increasingly important. A key mechanism for this process is narrative—the stories we tell about the world, whether in terms of politics or technology, which ena...

(This article belongs to the Proceedings of Proceedings of the IS4SI 2017 Summit DIGITALISATION FOR A SUSTAINABLE SOCIETY, Gothenburg, Sweden, 12–16 June 2017.)
  • Article
  • Open Access
20 Citations
8,445 Views
16 Pages

1 April 2017

We propose a novel feature selection method based on quadratic mutual information which has its roots in Cauchy–Schwarz divergence and Renyi entropy. The method uses the direct estimation of quadratic mutual information from data samples using Gaussi...

(This article belongs to the Collection Advances in Applied Statistical Mechanics)
  • Abstract
  • Open Access
1,970 Views
3 Pages

This dissertation studies the problem of information selection of scientific and technical communication. In this thesis I analyze the characteristic, essence, element, structure, function, effect and obstruct in scientific and technical communicatio...

(This article belongs to the Proceedings of Proceedings of the IS4SI 2017 Summit DIGITALISATION FOR A SUSTAINABLE SOCIETY, Gothenburg, Sweden, 12–16 June 2017.)
  • Article
  • Open Access
3 Citations
3,596 Views
18 Pages

31 August 2020

We consider a nonparametric Generative Tree Model and discuss a problem of selecting active predictors for the response in such scenario. We investigated two popular information-based selection criteria: Conditional Infomax Feature Extraction (CIFE)...

(This article belongs to the Special Issue Nonparametric Statistical Inference with an Emphasis on Information-Theoretic Methods)
  • Feature Paper
  • Article
  • Open Access
19 Citations
5,274 Views
25 Pages

4 August 2022

We review the principal information theoretic tools and their use for feature selection, with the main emphasis on classification problems with discrete features. Since it is known that empirical versions of conditional mutual information perform poo...

(This article belongs to the Special Issue Information Theoretic Criteria: New Theoretical Developments and Applications)
  • Feature Paper
  • Article
  • Open Access
11 Citations
5,942 Views
10 Pages

21 January 2019

Feature selection aims to select the smallest feature subset that yields the minimum generalization error. In the rich literature in feature selection, information theory-based approaches seek a subset of features such that the mutual information bet...

(This article belongs to the Special Issue Information Theoretic Learning and Kernel Methods)
  • Article
  • Open Access
23 Citations
9,519 Views
19 Pages

4 November 2019

We show a link between Bayesian inference and information theory that is useful for model selection, assessment of information entropy and experimental design. We align Bayesian model evidence (BME) with relative entropy and cross entropy in order to...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
19 Citations
4,689 Views
23 Pages

3 October 2021

Information criteria such as the Akaike information criterion (AIC) and Bayesian information criterion (BIC) are commonly used for model selection. However, the current theory does not support unconventional data, so naive use of these criteria is no...

(This article belongs to the Special Issue Methods and Applications of Statistics in the Social and Health Sciences)
  • Review
  • Open Access
11 Citations
5,193 Views
16 Pages

Any piece of information is a selection from a set of possibilities. In this paper, this set is called a “domain”. Digital information consists of number sequences, which are selections from a domain. At present, these number sequences ar...

(This article belongs to the Special Issue The Future of Healthcare: Telemedicine, Public eHealth, and Big Data)
  • Article
  • Open Access
34 Citations
12,036 Views
42 Pages

19 April 2011

Feature selection is an important step in building accurate classifiers and provides better understanding of the data sets. In this paper, we propose a feature subset selection method based on high-dimensional mutual information. We also propose to u...

  • Article
  • Open Access
44 Citations
9,782 Views
17 Pages

2 July 2019

Feature interaction is a newly proposed feature relevance relationship, but the unintentional removal of interactive features can result in poor classification performance for this relationship. However, traditional feature selection algorithms mainl...

(This article belongs to the Special Issue Symmetry in Engineering Sciences)
  • Article
  • Open Access
18 Citations
4,876 Views
16 Pages

22 November 2019

With the increasing awareness of global environmental protection, green production has become a significant part for enterprises to remain in a competitive position. For a manufacturing company, selecting the most suitable green supplier plays an imp...

(This article belongs to the Collection Advanced Methodologies for Sustainability Assessment: Theory and Practice)
  • Article
  • Open Access
11 Citations
2,479 Views
12 Pages

Mutual Information-Based Variable Selection on Latent Class Cluster Analysis

  • Andreas Riyanto,
  • Heri Kuswanto and
  • Dedy Dwi Prastyo

29 April 2022

Machine learning techniques are becoming indispensable tools for extracting useful information. Among many machine learning techniques, variable selection is a solution used for converting high-dimensional data into simpler data while still preservin...

  • Article
  • Open Access
2 Citations
2,396 Views
37 Pages

10 February 2025

Taking into account retailers’ resistance and operational costs, manufacturer enterprises are facing the optimal decision-making problem of whether and what kind of direct sales channels to open. Meanwhile, against the backdrop of asymmetric de...

(This article belongs to the Section Supply Chain Management)
  • Article
  • Open Access
3,399 Views
14 Pages

Variable Selection Using Deep Variational Information Bottleneck with Drop-Out-One Loss

  • Junlong Pan,
  • Weifu Li,
  • Liyuan Liu,
  • Kang Jia and ,
  • Tong Liu and
  • Fen Chen
  • + 1 author+ 0 author

26 February 2023

The information bottleneck (IB) model aims to find the optimal representations of input variables with respect to the response variable. While it has been widely used in the machine-learning community, research from the perspective of the information...

  • Article
  • Open Access
1 Citations
948 Views
24 Pages

9 April 2026

With the rapid growth of data, feature selection has become essential for improving machine learning performance. However, most existing unsupervised feature selection methods rely on greedy strategies, which often lead to suboptimal solutions. Moreo...

(This article belongs to the Special Issue Symmetry/Asymmetry in Fuzzy Sets and Fuzzy Systems)
  • Article
  • Open Access
6 Citations
10,130 Views
27 Pages

11 October 2010

Mutual information between a target variable and a feature subset is extensively used as a feature subset selection criterion. This work contributes to a more thorough understanding of the evolution of the mutual information as a function of the numb...

(This article belongs to the Special Issue Advances in Information Theory)
  • Article
  • Open Access
6 Citations
4,007 Views
29 Pages

MASISCo—Methodological Approach for the Selection of Information Security Controls

  • Mauricio Diéguez,
  • Carlos Cares,
  • Cristina Cachero and
  • Jorge Hochstetter

13 January 2023

As cyber-attacks grow worldwide, companies have begun to realize the importance of being protected against malicious actions that seek to violate their systems and access their information assets. Faced with this scenario, organizations must carry ou...

(This article belongs to the Collection Innovation in Information Security)
  • Article
  • Open Access
7,505 Views
12 Pages

14 June 2010

This paper develops a semi-parametric, Information-Theoretic method for estimating parameters for nonlinear data generated under a sample selection process. Considering the sample selection as a set of inequalities makes this model inherently nonline...

  • Article
  • Open Access
10 Citations
5,343 Views
12 Pages

As the classic feature selection algorithm, the Relief algorithm has the advantages of simple computation and high efficiency, but the algorithm itself is limited to only dealing with binary classification problems, and the comprehensive distinguishi...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
15 Citations
3,822 Views
17 Pages

31 March 2024

Ransomware attacks have emerged as a significant threat to critical data and systems, extending beyond traditional computers to mobile and IoT/Cyber–Physical Systems. This study addresses the need to detect early ransomware behavior when only l...

(This article belongs to the Special Issue Novel Approaches for Information Security in Complex Cyber-Physical Systems)
  • Article
  • Open Access
14 Citations
3,684 Views
17 Pages

21 March 2019

In multi-scale information systems, the information is often characterized at multi scales and multi levels. To facilitate the computational process of multi-scale information systems, we employ the matrix method to represent the multi-scale informat...

  • Article
  • Open Access
9 Citations
2,954 Views
13 Pages

7 September 2022

The filter feature selection algorithm is habitually used as an effective way to reduce the computational cost of data analysis by selecting and implementing only a subset of original features into the study. Mutual information (MI) is a popular meas...

  • Article
  • Open Access
2 Citations
2,626 Views
18 Pages

16 November 2021

Targeting the challenge of determining the degree of blockage in buried pipelines and the difficulty of effectively extracting blockage features, a blockage detection method integrating variational mode decomposition (VMD) and information gain is pro...

  • Article
  • Open Access
10 Citations
7,021 Views
21 Pages

Filter-Type Variable Selection Based on Information Measures for Regression Tasks

  • Pedro Latorre Carmona,
  • José Martínez Sotoca and
  • Filiberto Pla

17 February 2012

This paper presents a supervised variable selection method applied to regression problems. This method selects the variables applying a hierarchical clustering strategy based on information measures. The proposed technique can be applied to single-ou...

  • Article
  • Open Access
109 Views
29 Pages

2 November 2026

Extreme learning machines (ELMs) solve output weights in closed form, so an optimized population of ELMs leaves open which members should form the ensemble. We report a controlled comparison of five rules for this selection step inLEA-EELM, where a L...

(This article belongs to the Special Issue Information-Induced Geometries in Statistics, Data Analysis, and Applied Research)
  • Article
  • Open Access
30 Citations
3,530 Views
22 Pages

2 June 2021

Feature selection is one of the core contents of rough set theory and application. Since the reduction ability and classification performance of many feature selection algorithms based on rough set theory and its extensions are not ideal, this paper...

  • Article
  • Open Access
1,072 Views
24 Pages

30 May 2025

A critical step for gene selection algorithms using rough set theory is the establishment of a gene evaluation function to assess the classification ability of candidate gene subsets. The concept of dependency in a classic neighborhood rough set mode...

  • Article
  • Open Access
15 Citations
4,778 Views
15 Pages

Information Theoretic Multi-Target Feature Selection via Output Space Quantization

  • Konstantinos Sechidis,
  • Eleftherios Spyromitros-Xioufis and
  • Ioannis Vlahavas

31 August 2019

A key challenge in information theoretic feature selection is to estimate mutual information expressions that capture three desirable terms—the relevancy of a feature with the output, the redundancy and the complementarity between groups of fea...

(This article belongs to the Special Issue Information Theoretic Feature Selection Methods for Big Data)
  • Article
  • Open Access
47 Citations
6,137 Views
20 Pages

A Filter Feature Selection Algorithm Based on Mutual Information for Intrusion Detection

  • Fei Zhao,
  • Jiyong Zhao,
  • Xinxin Niu,
  • Shoushan Luo and
  • Yang Xin

1 September 2018

For a large number of network attacks, feature selection is used to improve intrusion detection efficiency. A new mutual information algorithm of the redundant penalty between features (RPFMI) algorithm with the ability to select optimal features is...

  • Extended Abstract
  • Open Access
1,766 Views
3 Pages

Feature Selection with Limited Bit Depth Mutual Information for Embedded Systems

  • Laura Morán-Fernández,
  • Verónica Bolón-Canedo and
  • Amparo Alonso-Betanzos

17 September 2018

Data is growing at an unprecedented pace. With the variety, speed and volume of data flowing through networks and databases, newer approaches based on machine learning are required. But what is really big in Big Data? Should it depend on the numerica...

(This article belongs to the Proceedings of XoveTIC Congress 2018)
  • Article
  • Open Access
601 Views
18 Pages

Feature Selection Based on Height Mutual Information in Airborne LiDAR Filtering

  • Zhan Cai,
  • Luying Zhao,
  • Qiuli Chen,
  • Zhijun He and ,
  • Shaoyun Bi and
  • Xiaolong Xu
  • + 1 author+ 0 author

30 March 2026

Filtering constitutes a critical step in the post-processing of airborne Light Detection And Ranging (LiDAR) data. Over the past decade, machine learning has emerged as a prominent methodological paradigm across numerous disciplines, attracting signi...

  • Article
  • Open Access
3 Citations
3,990 Views
22 Pages

PCMINN: A GPU-Accelerated Conditional Mutual Information-Based Feature Selection Method

  • Nikolaos Papaioannou,
  • Georgios Myllis,
  • Alkiviadis Tsimpiris,
  • Stamatis Aggelopoulos and
  • Vasiliki Vrana

In feature selection, it is crucial to identify features that are not only relevant to the target variable but also non-redundant. Conditional Mutual Information Nearest-Neighbor (CMINN) is an algorithm developed to address this challenge by using Co...

(This article belongs to the Special Issue Feature Papers in Information in 2024–2025)
  • Article
  • Open Access
23 Citations
5,361 Views
25 Pages

The Role of Mutual Information Estimator Choice in Feature Selection: An Empirical Study on mRMR

  • Nikolaos Papaioannou,
  • Georgios Myllis,
  • Alkiviadis Tsimpiris and
  • Vasiliki Vrana

25 August 2025

Maximum Relevance Minimum Redundancy (mRMR) is a widely used feature selection method that is applied in a wide range of applications in various fields. mRMR adds to the optimal subset the features that have high relevance to the target variable whil...

(This article belongs to the Section Information and Communications Technology)
  • Article
  • Open Access
11 Citations
3,192 Views
17 Pages

A Novel Variable Selection Method Based on Binning-Normalized Mutual Information for Multivariate Calibration

  • Liang Zhong,
  • Ruiqi Huang,
  • Lele Gao,
  • Jianan Yue and ,
  • Bing Zhao,
  • Lei Nie,
  • Lian Li,
  • Aoli Wu,
  • Kefan Zhang and
  • Hengchang Zang
  • + 8 authors+ 3 authors

26 July 2023

Variable (wavelength) selection is essential in the multivariate analysis of near-infrared spectra to improve model performance and provide a more straightforward interpretation. This paper proposed a new variable selection method named binning-norma...

(This article belongs to the Topic Advances in Spectroscopic and Chromatographic Techniques)
  • Article
  • Open Access
18 Citations
4,836 Views
19 Pages

5 December 2019

In this paper, normalized mutual information feature selection (NMIFS) and tabu search (TS) are integrated to develop a new variable selection algorithm for soft sensors. NMIFS is applied to select influential variables contributing to the output var...

(This article belongs to the Special Issue Soft Sensors)
  • Article
  • Open Access
75 Citations
10,301 Views
49 Pages

19 July 2018

With a great emphasis on both social and environmental responsibilities, sustainable supply chain management has gradually been adopted and promoted as an innovative business model. In sustainable supply chain practice, the choice of sustainable supp...

(This article belongs to the Special Issue Sustainable Industrial Engineering along Product-Service Life Cycle/Supply Chain)
  • Article
  • Open Access
8 Citations
3,017 Views
17 Pages

29 November 2021

This paper aims to present an improved evacuation model, which is capable of simulating individual exit selection behavior based on the acquisition and processing of information, especially in dangerous and unfamiliar environments. Firstly, an evacua...

(This article belongs to the Section Sustainable Transportation)
  • Article
  • Open Access
24 Citations
5,110 Views
17 Pages

Improving Bearing Fault Diagnosis Using Maximum Information Coefficient Based Feature Selection

  • Xianghong Tang,
  • Jiachen Wang,
  • Jianguang Lu,
  • Guokai Liu and
  • Jiadui Chen

2 November 2018

Effective feature selection can help improve the classification performance in bearing fault diagnosis. This paper proposes a novel feature selection method based on bearing fault diagnosis called Feature-to-Feature and Feature-to-Category- Maximum I...

(This article belongs to the Special Issue Fault Detection and Diagnosis in Mechatronics Systems)
  • Article
  • Open Access
26 Citations
6,727 Views
17 Pages

Mutual Information-Based Inputs Selection for Electric Load Time Series Forecasting

  • Miloš Božić,
  • Miloš Stojanović,
  • Zoran Stajić and
  • Nenad Floranović

27 February 2013

Providing accurate load forecast to electric utility corporations is essential in order to reduce their operational costs and increase profits. Hence, training set selection is an important preprocessing step which has to be considered in practice in...

  • Article
  • Open Access
2 Citations
2,500 Views
23 Pages

A Supplier Selection Decision-Making Approach for Complex Product Development Based on Hesitant Fuzzy Information

  • Baodong Li,
  • Jiafu Su,
  • Boqiao Yuan,
  • Lvcheng Li and ,
  • Yihuan Zhao,
  • Zhidan Qin and
  • Li Qian
  • + 2 authors+ 0 author

25 October 2023

During the development process of complex products, selecting the best desirable alternative supplier is a challenge since an improperly selected alternative may cause losing capacity and increasing the cycle time and cost of development for a compan...

(This article belongs to the Special Issue Editorial Board Members’ Collection Series: Fuzzy Modeling, Optimization and Computational Intelligence)
  • Article
  • Open Access
1 Citations
592 Views
21 Pages

10 April 2026

Feature selection is essential for high-dimensional multi-source feature analysis, particularly in Internet of Things (IoT) environments characterized by data heterogeneity, redundancy, and noise. To address the need to balance classification perform...

(This article belongs to the Section Internet of Things)
  • Article
  • Open Access
10 Citations
4,892 Views
17 Pages

9 March 2018

Weather information is an important factor in short-term load forecasting (STLF). However, for a long time, more importance has always been attached to forecasting models instead of other processes such as the introduction of weather factors or featu...

  • Article
  • Open Access
11 Citations
4,371 Views
13 Pages

13 October 2018

The information entropy developed by Shannon is an effective measure of uncertainty in data, and the rough set theory is a useful tool of computer applications to deal with vagueness and uncertainty data circumstances. At present, the information ent...

(This article belongs to the Section Information Theory, Probability and Statistics)
  • Article
  • Open Access
1 Citations
1,278 Views
13 Pages

Genomic Selection for Economic Traits in Inner Mongolia Cashmere Goats by Integrating GWAS Prior Information

  • Haijiao Xi,
  • Qi Xu,
  • Huanfeng Yao,
  • Zihao Shen and ,
  • Bohan Zhou,
  • Qi Lv,
  • Jinquan Li,
  • Ruijun Wang,
  • Yanjun Zhang and
  • Zhiying Wang
  • + 6 authors+ 1 author

15 October 2025

The accuracy of genomic selection has a significant impact on the selection of superior individuals in livestock. Studies have reported that integrating GWAS information can improve the accuracy of genomic prediction. In this study, phenotypic data,...

  • Article
  • Open Access
6 Citations
2,784 Views
19 Pages

Efficient and Intelligent Feature Selection via Maximum Conditional Mutual Information for Microarray Data

  • Jiangnan Zhang,
  • Shaojing Li,
  • Huaichuan Yang,
  • Jingtao Jiang and
  • Hongtao Shi

3 July 2024

The challenge of analyzing microarray datasets is significantly compounded by the curse of dimensionality and the complexity of feature interactions. Addressing this, we propose a novel feature selection algorithm based on maximum conditional mutual...

(This article belongs to the Section Applied Biosciences and Bioengineering)
  • Article
  • Open Access
8 Citations
2,843 Views
13 Pages

Genomic Selection for Weaning Weight in Alpine Merino Sheep Based on GWAS Prior Marker Information

  • Haifeng Wang,
  • Chenglan Li,
  • Jianye Li,
  • Rui Zhang and ,
  • Xuejiao An,
  • Chao Yuan,
  • Tingting Guo and
  • Yaojing Yue
  • + 3 authors+ 0 author

27 June 2024

This study aims to compare the accuracy of genomic estimated breeding values (GEBV) estimated using a genomic best linear unbiased prediction (GBLUP) method and GEBV estimates incorporating prior marker information from a genome-wide association stud...

(This article belongs to the Topic Application of Reproductive and Genomic Biotechnologies for Livestock Breeding and Selection)
  • Article
  • Open Access
28 Citations
3,435 Views
15 Pages

Genomic Selection for Live Weight in the 14th Month in Alpine Merino Sheep Combining GWAS Information

  • Chenglan Li,
  • Jianye Li,
  • Haifeng Wang,
  • Rui Zhang and ,
  • Xuejiao An,
  • Chao Yuan,
  • Tingting Guo and
  • Yaojing Yue
  • + 3 authors+ 0 author

14 November 2023

Alpine Merino Sheep is a novel breed reared from Australian Merino Sheep as the father and Gansu Alpine Fine-Wool Sheep as the mother, living all year in cold and arid alpine areas with exceptional wool quality and meat performance. Body weight is an...

(This article belongs to the Section Animal Genetics and Genomics)
  • Article
  • Open Access
8 Citations
3,496 Views
24 Pages

17 May 2019

Sustainable supplier selection has become a strategic activity to enhance the competitiveness of sustainable supply chain management. Research on sustainable supplier selection is considering increasingly more practical factors, such as the uncertain...

(This article belongs to the Section Economic and Business Aspects of Sustainability)
  • Article
  • Open Access
46 Citations
6,977 Views
19 Pages

30 August 2017

The selection of a desirable site for constructing a pumped hydro energy storage plant (PHESP) plays a vital important role in the whole life cycle. However, little research has been done on the site selection of PHESP, which affects the rapid develo...

(This article belongs to the Section Information Theory and Methodology)

of 603