Next Article in Journal
Biosemiotic Entropy: Concluding the Series
Previous Article in Journal
Application of a Modified Entropy Computational Method in Assessing the Complexity of Pulse Wave Velocity Signals in Healthy and Diabetic Subjects
Entropy 2014, 16(7), 4044-4059; doi:10.3390/e16074044

Entropy and Its Discontents: A Note on Definitions

Dipartimento di Matematica and TIRES, Universit脿 di Bari, INFN Sezione di Bari via E. Orabona 4, 70125 Bari, Italy
Received: 29 May 2014 / Revised: 27 June 2014 / Accepted: 8 July 2014 / Published: 17 July 2014
(This article belongs to the Section Information Theory)
View Full-Text   |   Download PDF [431 KB, uploaded 24 February 2015]   |   Browse Figures


The routine definitions of Shannon entropy for both discrete and continuous probability laws show inconsistencies that make them not reciprocally coherent. We propose a few possible modifications of these quantities so that: (1) they no longer show incongruities; and (2) they go one into the other in a suitable limit as the result of a renormalization. The properties of the new quantities would slightly differ from that of the usual entropies in a few other respects.
Keywords: Shannon entropy; continuous and discrete probability laws; renormalization Shannon entropy; continuous and discrete probability laws; renormalization
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Share & Cite This Article

Further Mendeley | CiteULike
Export to BibTeX |
EndNote |
MDPI and ACS Style

Petroni, N.C. Entropy and Its Discontents: A Note on Definitions. Entropy 2014, 16, 4044-4059.

View more citation formats

Related Articles

Article Metrics

For more information on the journal, click here


[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert