Open AccessThis article is
- freely available
Entropy 2008, 10(4), 493-506; doi:10.3390/e10040493
Entropy and Uncertainty
Received: 17 June 2008; Accepted: 6 August 2008 / Published: 16 October 2008
(This article belongs to the Special Issue Concepts of Entropy and Their Applications - Papers presented at the Meeting at University of Melbourne, 26 November - 11 December 2007)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: We give a survey of the basic statistical ideas underlying the definition of entropy in information theory and their connections with the entropy in the theory of dynamical systems and in statistical mechanics.
Keywords: Entropy; relative entropy; uncertainty; information theory