Next Article in Journal
Study of Nonlinear Models of Oscillatory Systems by Applying an Intelligent Computational Technique
Next Article in Special Issue
Unraveling Hidden Major Factors by Breaking Heterogeneity into Homogeneous Parts within Many-System Problems
Previous Article in Journal
Thermodynamic Definitions of Temperature and Kappa and Introduction of the Entropy Defect
Previous Article in Special Issue
Categorical Exploratory Data Analysis: From Multiclass Classification and Response Manifold Analytics Perspectives of Baseball Pitching Dynamics
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Categorical Nature of Major Factor Selection via Information Theoretic Measurements

1
Institute of Statistical Science, Academia Sinica, Taipei 11529, Taiwan
2
Department of Statistics, National Chengchi University, Taipei 11605, Taiwan
3
Department of Statistics, University of California, Davis, CA 95616, USA
*
Author to whom correspondence should be addressed.
Entropy 2021, 23(12), 1684; https://doi.org/10.3390/e23121684
Submission received: 11 November 2021 / Revised: 8 December 2021 / Accepted: 13 December 2021 / Published: 15 December 2021
(This article belongs to the Special Issue Information Complexity in Structured Data)

Abstract

Without assuming any functional or distributional structure, we select collections of major factors embedded within response-versus-covariate (Re-Co) dynamics via selection criteria [C1: confirmable] and [C2: irrepaceable], which are based on information theoretic measurements. The two criteria are constructed based on the computing paradigm called Categorical Exploratory Data Analysis (CEDA) and linked to Wiener–Granger causality. All the information theoretical measurements, including conditional mutual information and entropy, are evaluated through the contingency table platform, which primarily rests on the categorical nature within all involved features of any data types: quantitative or qualitative. Our selection task identifies one chief collection, together with several secondary collections of major factors of various orders underlying the targeted Re-Co dynamics. Each selected collection is checked with algorithmically computed reliability against the finite sample phenomenon, and so is each member’s major factor individually. The developments of our selection protocol are illustrated in detail through two experimental examples: a simple one and a complex one. We then apply this protocol on two data sets pertaining to two somewhat related but distinct pitching dynamics of two pitch types: slider and fastball. In particular, we refer to a specific Major League Baseball (MLB) pitcher and we consider data of multiple seasons.
Keywords: CEDA; conditional entropy; conditional mutual information; heterogeneity; information gain CEDA; conditional entropy; conditional mutual information; heterogeneity; information gain

Share and Cite

MDPI and ACS Style

Chen, T.-L.; Chou, E.P.; Fushing, H. Categorical Nature of Major Factor Selection via Information Theoretic Measurements. Entropy 2021, 23, 1684. https://doi.org/10.3390/e23121684

AMA Style

Chen T-L, Chou EP, Fushing H. Categorical Nature of Major Factor Selection via Information Theoretic Measurements. Entropy. 2021; 23(12):1684. https://doi.org/10.3390/e23121684

Chicago/Turabian Style

Chen, Ting-Li, Elizabeth P. Chou, and Hsieh Fushing. 2021. "Categorical Nature of Major Factor Selection via Information Theoretic Measurements" Entropy 23, no. 12: 1684. https://doi.org/10.3390/e23121684

APA Style

Chen, T.-L., Chou, E. P., & Fushing, H. (2021). Categorical Nature of Major Factor Selection via Information Theoretic Measurements. Entropy, 23(12), 1684. https://doi.org/10.3390/e23121684

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop