Entropy and Effective Support Size
AbstractNotion of Effective size of support (Ess) of a random variable is introduced. A smallset of natural requirements that a measure of Ess should satisfy is presented. The measure withprescribed properties is in a direct (exp-) relationship to the family of R ́nyi’s α-entropies which eincludes also Shannon’s entropy H. Considerations of choice of the value of α imply that exp(H)appears to be the most appropriate measure of Ess.Entropy and Ess can be viewed thanks to their log / exp relationship as two aspects of the samething. In Probability and Statistics the Ess aspect could appear more basic than the entropic one. View Full-Text
Share & Cite This Article
Grendar, M. Entropy and Effective Support Size. Entropy 2006, 8, 169-174.
Grendar M. Entropy and Effective Support Size. Entropy. 2006; 8(3):169-174.Chicago/Turabian Style
Grendar, Marian. 2006. "Entropy and Effective Support Size." Entropy 8, no. 3: 169-174.