Next Article in Journal
Quantum Entropy and Its Applications to Quantum Communication and Statistical Physics
Next Article in Special Issue
Principle of Minimum Discrimination Information and Replica Dynamics
Previous Article in Journal
Nearest Neighbor Estimates of Entropy for Multivariate Circular Distributions
Previous Article in Special Issue
Engineering Model Reduction and Entropy-based Lyapunov Functions in Chemical Reaction Kinetics
Article Menu

Article Versions

Export Article

Open AccessArticle
Entropy 2010, 12(5), 1145-1193; doi:10.3390/e12051145

Entropy: The Markov Ordering Approach

1
Department of Mathematics, University of Leicester, Leicester, UK
2
Institute of Space and Information Technologies, Siberian Federal University, Krasnoyarsk, Russia
3
Department of Resource Economics, University of California, Berkeley, CA, USA
*
Author to whom correspondence should be addressed.
Received: 1 March 2010 / Revised: 30 April 2010 / Accepted: 4 May 2010 / Published: 7 May 2010
(This article belongs to the Special Issue Entropy in Model Reduction)
Download PDF [539 KB, uploaded 24 February 2015]   |  

Abstract

The focus of this article is on entropy and Markov processes. We study the properties of functionals which are invariant with respect to monotonic transformations and analyze two invariant “additivity” properties: (i) existence of a monotonic transformation which makes the functional additive with respect to the joining of independent systems and (ii) existence of a monotonic transformation which makes the functional additive with respect to the partitioning of the space of states. All Lyapunov functionals for Markov chains which have properties (i) and (ii) are derived. We describe the most general ordering of the distribution space, with respect to which all continuous-time Markov processes are monotonic (the Markov order). The solution differs significantly from the ordering given by the inequality of entropy growth. For inference, this approach results in a convex compact set of conditionally “most random” distributions.
Keywords: Markov process; Lyapunov function; entropy functionals; attainable region; MaxEnt; inference Markov process; Lyapunov function; entropy functionals; attainable region; MaxEnt; inference
Figures

This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Gorban, A.N.; Gorban, P.A.; Judge, G. Entropy: The Markov Ordering Approach. Entropy 2010, 12, 1145-1193.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top