Open AccessThis article is
- freely available
The Entropy of a Discrete Real Variable
SPAWAR Systems Center Atlantic, Joint Base Charleston, North Charleston, SC 29406, USA
Received: 12 June 2012; in revised form: 3 August 2012 / Accepted: 6 August 2012 / Published: 17 August 2012
Abstract: The discrete Shannon entropy H was formulated only to measure indeterminacy effected through a set of probabilities, but the indeterminacy in a real-valued discrete variable depends on both the allowed outcomes x and the corresponding probabilities Þ. A fundamental measure that is sensitive to both x and p is derived here from the total differential entropy of a continuous real variable and its conjugate in the discrete limit, where the conjugate is universally eliminated. The asymptotic differential entropy recovers H plus the new measure, named ≡, which provides a novel probe of intrinsic organization in sequences of real numbers.
Keywords: Shannon entropy; information entropy; information theory
Citations to this Article
Cite This Article
MDPI and ACS Style
Funkhouser, S. The Entropy of a Discrete Real Variable. Entropy 2012, 14, 1522-1538.
Funkhouser S. The Entropy of a Discrete Real Variable. Entropy. 2012; 14(8):1522-1538.
Funkhouser, Scott. 2012. "The Entropy of a Discrete Real Variable." Entropy 14, no. 8: 1522-1538.