Next Article in Journal
Generalized Ideal Gas Equations for Structureful Universe
Previous Article in Journal
On the Propagation of Blast Wave in Earth′s Atmosphere: Adiabatic and Isothermal Flow
Entropy 2006, 8(3), 169-174; doi:10.3390/e8030169

Entropy and Effective Support Size

Department of Mathematics, FPV UMB, Tajovskeho 40, 974 01 Banska Bystrica, Slovakia Institute of Measurement Science, Bratislava, Slovakia Institute of Mathematics and Computer Science, Banska Bystrica, Slovakia
Received: 5 May 2006 / Accepted: 10 August 2006 / Published: 21 August 2006
Download PDF [156 KB, uploaded 24 February 2015]


Notion of Effective size of support (Ess) of a random variable is introduced. A smallset of natural requirements that a measure of Ess should satisfy is presented. The measure withprescribed properties is in a direct (exp-) relationship to the family of R ́nyi’s α-entropies which eincludes also Shannon’s entropy H. Considerations of choice of the value of α imply that exp(H)appears to be the most appropriate measure of Ess.Entropy and Ess can be viewed thanks to their log / exp relationship as two aspects of the samething. In Probability and Statistics the Ess aspect could appear more basic than the entropic one.
Keywords: R´enyi’s entropy; Shannon’s entropy; support; interpretation; Probability; Statistics. R´enyi’s entropy; Shannon’s entropy; support; interpretation; Probability; Statistics.
This is an open access article distributed under the Creative Commons Attribution License (CC BY) which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Share & Cite This Article

Further Mendeley | CiteULike
Export to BibTeX |
MDPI and ACS Style

Grendar, M. Entropy and Effective Support Size. Entropy 2006, 8, 169-174.

View more citation formats

Related Articles

Article Metrics

For more information on the journal, click here


Cited By

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert