Entropy 2005, 7(4), 253-299; doi:10.3390/e7040253

Differential entropy and time

Received: 22 August 2005; Accepted: 17 October 2005 / Published: 18 October 2005
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: We give a detailed analysis of the Gibbs-type entropy notion and its dynamical behavior in case of time-dependent continuous probability distributions of varied origins: related to classical and quantum systems. The purpose-dependent usage of conditional Kullback-Leibler and Gibbs (Shannon) entropies is explained in case of non-equilibrium Smoluchowski processes. A very different temporal behavior of Gibbs and Kullback entropies is confronted. A specific conceptual niche is addressed, where quantum von Neumann, classical Kullback-Leibler and Gibbs entropies can be consistently introduced as information measures for the same physical system. If the dynamics of probability densities is driven by the Schrödinger picture wave-packet evolution, Gibbs-type and related Fisher information functionals appear to quantify nontrivial power transfer processes in the mean. This observation is found to extend to classical dissipative processes and supports the view that the Shannon entropy dynamics provides an insight into physically relevant non-equilibrium phenomena, which are inaccessible in terms of the Kullback-Leibler entropy and typically ignored in the literature.
Keywords: differential entropy; von Neumann entropy; Shannon entropy; Kullback-Leibler entropy; Gibbs entropy; entropy methods; entropy functionals; Fisher information; Ornstein-Uhlenbeck process; Schrödinger picture evolution; dynamics of probability densities; invariant density
PDF Full-text Download PDF Full-Text [323 KB, uploaded 16 September 2008 11:01 CEST]

Export to BibTeX |

MDPI and ACS Style

Garbaczewski, P. Differential entropy and time. Entropy 2005, 7, 253-299.

AMA Style

Garbaczewski P. Differential entropy and time. Entropy. 2005; 7(4):253-299.

Chicago/Turabian Style

Garbaczewski, Piotr. 2005. "Differential entropy and time." Entropy 7, no. 4: 253-299.

Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert