Open AccessThis article is
- freely available
Recent Progresses in Characterising Information Inequalities
Institute for Telecommunications Research, University of South Australia, Australia
Received: 1 December 2010; in revised form: 19 January 2011 / Accepted: 28 January 2011 / Published: 31 January 2011
Abstract: In this paper, we present a revision on some of the recent progresses made in characterising and understanding information inequalities, which are the fundamental physical laws in communications and compression. We will begin with the introduction of a geometric framework for information inequalities, followed by the first non-Shannon inequality proved by Zhang et al. in 1998 . The discovery of this non-Shannon inequality is a breakthrough in the area and has led to the subsequent discovery of many more non-Shannon inequalities. We will also review the close relations between information inequalities and other research areas such as Kolmogorov complexity, determinantal inequalities, and group-theoretic inequalities. These relations have led to non-traditional techniques in proving information inequalities and at the same time made impacts back onthose related areas by the introduction of information-theoretic tools.
Keywords: determinantal inequalities; Greene’s Theorem; Kolmogorov complexity; quasi-uniformity; Shannon entropies; subspace rank inequalities
Citations to this Article
Cite This Article
MDPI and ACS Style
Chan, T. Recent Progresses in Characterising Information Inequalities. Entropy 2011, 13, 379-401.
Chan T. Recent Progresses in Characterising Information Inequalities. Entropy. 2011; 13(2):379-401.
Chan, Terence. 2011. "Recent Progresses in Characterising Information Inequalities." Entropy 13, no. 2: 379-401.