Next Article in Journal
Biosemiotic Entropy: Concluding the Series
Previous Article in Journal
Application of a Modified Entropy Computational Method in Assessing the Complexity of Pulse Wave Velocity Signals in Healthy and Diabetic Subjects
Article Menu

Export Article

Open AccessArticle
Entropy 2014, 16(7), 4044-4059; doi:10.3390/e16074044

Entropy and Its Discontents: A Note on Definitions

Dipartimento di Matematica and TIRES, Universit脿 di Bari, INFN Sezione di Bari via E. Orabona 4, 70125 Bari, Italy
Received: 29 May 2014 / Revised: 27 June 2014 / Accepted: 8 July 2014 / Published: 17 July 2014
(This article belongs to the Section Information Theory)
View Full-Text   |   Download PDF [431 KB, uploaded 24 February 2015]   |  


The routine definitions of Shannon entropy for both discrete and continuous probability laws show inconsistencies that make them not reciprocally coherent. We propose a few possible modifications of these quantities so that: (1) they no longer show incongruities; and (2) they go one into the other in a suitable limit as the result of a renormalization. The properties of the new quantities would slightly differ from that of the usual entropies in a few other respects.
Keywords: Shannon entropy; continuous and discrete probability laws; renormalization Shannon entropy; continuous and discrete probability laws; renormalization
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Petroni, N.C. Entropy and Its Discontents: A Note on Definitions. Entropy 2014, 16, 4044-4059.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top