Entropy 2005, 7(4), 253-299; doi:10.3390/e7040253
Review

Differential entropy and time

Institute of Physics, University of Zielona Góra, ul. Szafrana 4a, 65-516 Zielona Góra, Poland
Received: 22 August 2005; Accepted: 17 October 2005 / Published: 18 October 2005
PDF Full-text Download PDF Full-Text [323 KB, uploaded 16 September 2008 11:01 CEST]
Abstract: We give a detailed analysis of the Gibbs-type entropy notion and its dynamical behavior in case of time-dependent continuous probability distributions of varied origins: related to classical and quantum systems. The purpose-dependent usage of conditional Kullback-Leibler and Gibbs (Shannon) entropies is explained in case of non-equilibrium Smoluchowski processes. A very different temporal behavior of Gibbs and Kullback entropies is confronted. A specific conceptual niche is addressed, where quantum von Neumann, classical Kullback-Leibler and Gibbs entropies can be consistently introduced as information measures for the same physical system. If the dynamics of probability densities is driven by the Schrödinger picture wave-packet evolution, Gibbs-type and related Fisher information functionals appear to quantify nontrivial power transfer processes in the mean. This observation is found to extend to classical dissipative processes and supports the view that the Shannon entropy dynamics provides an insight into physically relevant non-equilibrium phenomena, which are inaccessible in terms of the Kullback-Leibler entropy and typically ignored in the literature.
Keywords: differential entropy; von Neumann entropy; Shannon entropy; Kullback-Leibler entropy; Gibbs entropy; entropy methods; entropy functionals; Fisher information; Ornstein-Uhlenbeck process; Schrödinger picture evolution; dynamics of probability densities; invariant density

Article Statistics

Load and display the download statistics.

Citations to this Article

Cite This Article

MDPI and ACS Style

Garbaczewski, P. Differential entropy and time. Entropy 2005, 7, 253-299.

AMA Style

Garbaczewski P. Differential entropy and time. Entropy. 2005; 7(4):253-299.

Chicago/Turabian Style

Garbaczewski, Piotr. 2005. "Differential entropy and time." Entropy 7, no. 4: 253-299.

Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert