Next Article in Journal
Biosemiotic Entropy: Concluding the Series
Previous Article in Journal
Application of a Modified Entropy Computational Method in Assessing the Complexity of Pulse Wave Velocity Signals in Healthy and Diabetic Subjects
Article Menu

Export Article

Open AccessArticle
Entropy 2014, 16(7), 4044-4059;

Entropy and Its Discontents: A Note on Definitions

Dipartimento di Matematica and TIRES, Università di Bari, INFN Sezione di Bari via E. Orabona 4, 70125 Bari, Italy
Received: 29 May 2014 / Revised: 27 June 2014 / Accepted: 8 July 2014 / Published: 17 July 2014
(This article belongs to the Section Information Theory)
View Full-Text   |   Download PDF [431 KB, uploaded 24 February 2015]


The routine definitions of Shannon entropy for both discrete and continuous probability laws show inconsistencies that make them not reciprocally coherent. We propose a few possible modifications of these quantities so that: (1) they no longer show incongruities; and (2) they go one into the other in a suitable limit as the result of a renormalization. The properties of the new quantities would slightly differ from that of the usual entropies in a few other respects. View Full-Text
Keywords: Shannon entropy; continuous and discrete probability laws; renormalization Shannon entropy; continuous and discrete probability laws; renormalization
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Share & Cite This Article

MDPI and ACS Style

Petroni, N.C. Entropy and Its Discontents: A Note on Definitions. Entropy 2014, 16, 4044-4059.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top