Differential entropy and time
Institute of Physics, University of Zielona Góra, ul. Szafrana 4a, 65-516 Zielona Góra, Poland
Entropy 2005, 7(4), 253-299; https://doi.org/10.3390/e7040253
Received: 22 August 2005 / Accepted: 17 October 2005 / Published: 18 October 2005
We give a detailed analysis of the Gibbs-type entropy notion and its dynamical behavior in case of time-dependent continuous probability distributions of varied origins: related to classical and quantum systems. The purpose-dependent usage of conditional Kullback-Leibler and Gibbs (Shannon) entropies is explained in case of non-equilibrium Smoluchowski processes. A very different temporal behavior of Gibbs and Kullback entropies is confronted. A specific conceptual niche is addressed, where quantum von Neumann, classical Kullback-Leibler and Gibbs entropies can be consistently introduced as information measures for the same physical system. If the dynamics of probability densities is driven by the Schrödinger picture wave-packet evolution, Gibbs-type and related Fisher information functionals appear to quantify nontrivial power transfer processes in the mean. This observation is found to extend to classical dissipative processes and supports the view that the Shannon entropy dynamics provides an insight into physically relevant non-equilibrium phenomena, which are inaccessible in terms of the Kullback-Leibler entropy and typically ignored in the literature. View Full-Text
Keywords: differential entropy; von Neumann entropy; Shannon entropy; Kullback-Leibler entropy; Gibbs entropy; entropy methods; entropy functionals; Fisher information; Ornstein-Uhlenbeck process; Schrödinger picture evolution; dynamics of probability densities; invariant density
This is an open access article distributed under the Creative Commons Attribution License
MDPI and ACS Style
Garbaczewski, P. Differential entropy and time. Entropy 2005, 7, 253-299.
AMA StyleShow more citation formats Show less citations formats
Garbaczewski P. Differential entropy and time. Entropy. 2005; 7(4):253-299.Chicago/Turabian Style
Garbaczewski, Piotr. 2005. "Differential entropy and time." Entropy 7, no. 4: 253-299.
Find Other Styles