Entropy 2011, 13(2), 379-401; doi:10.3390/e13020379

Recent Progresses in Characterising Information Inequalities

Received: 1 December 2010; in revised form: 19 January 2011 / Accepted: 28 January 2011 / Published: 31 January 2011
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: In this paper, we present a revision on some of the recent progresses made in characterising and understanding information inequalities, which are the fundamental physical laws in communications and compression. We will begin with the introduction of a geometric framework for information inequalities, followed by the first non-Shannon inequality proved by Zhang et al. in 1998 [1]. The discovery of this non-Shannon inequality is a breakthrough in the area and has led to the subsequent discovery of many more non-Shannon inequalities. We will also review the close relations between information inequalities and other research areas such as Kolmogorov complexity, determinantal inequalities, and group-theoretic inequalities. These relations have led to non-traditional techniques in proving information inequalities and at the same time made impacts back onthose related areas by the introduction of information-theoretic tools.
Keywords: determinantal inequalities; Greene’s Theorem; Kolmogorov complexity; quasi-uniformity; Shannon entropies; subspace rank inequalities

PDF Full-text Download PDF Full-Text [174 KB, uploaded 31 January 2011 11:36 CET]

Export to BibTeX |

MDPI and ACS Style

Chan, T. Recent Progresses in Characterising Information Inequalities. Entropy 2011, 13, 379-401.

AMA Style

Chan T. Recent Progresses in Characterising Information Inequalities. Entropy. 2011; 13(2):379-401.

Chicago/Turabian Style

Chan, Terence. 2011. "Recent Progresses in Characterising Information Inequalities." Entropy 13, no. 2: 379-401.

Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert