Information Landscape and Flux, Mutual Information Rate Decomposition and Connections to Entropy Production
AbstractWe explored the dynamics of two interacting information systems. We show that for the Markovian marginal systems, the driving force for information dynamics is determined by both the information landscape and information flux. While the information landscape can be used to construct the driving force to describe the equilibrium time-reversible information system dynamics, the information flux can be used to describe the nonequilibrium time-irreversible behaviors of the information system dynamics. The information flux explicitly breaks the detailed balance and is a direct measure of the degree of the nonequilibrium or time-irreversibility. We further demonstrate that the mutual information rate between the two subsystems can be decomposed into the equilibrium time-reversible and nonequilibrium time-irreversible parts, respectively. This decomposition of the Mutual Information Rate (MIR) corresponds to the information landscape-flux decomposition explicitly when the two subsystems behave as Markov chains. Finally, we uncover the intimate relationship between the nonequilibrium thermodynamics in terms of the entropy production rates and the time-irreversible part of the mutual information rate. We found that this relationship and MIR decomposition still hold for the more general stationary and ergodic cases. We demonstrate the above features with two examples of the bivariate Markov chains. View Full-Text
A printed edition of this Special Issue is available here.
Share & Cite This Article
Zeng, Q.; Wang, J. Information Landscape and Flux, Mutual Information Rate Decomposition and Connections to Entropy Production. Entropy 2017, 19, 678.
Zeng Q, Wang J. Information Landscape and Flux, Mutual Information Rate Decomposition and Connections to Entropy Production. Entropy. 2017; 19(12):678.Chicago/Turabian Style
Zeng, Qian; Wang, Jin. 2017. "Information Landscape and Flux, Mutual Information Rate Decomposition and Connections to Entropy Production." Entropy 19, no. 12: 678.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.