Next Article in Journal
A Two-stage Method for Solving Multi-resident Activity Recognition in Smart Environments
Previous Article in Journal
Possible Further Evidence for the Thixotropic Phenomenon of Water
Article Menu

Export Article

Open AccessArticle
Entropy 2014, 16(4), 2161-2183; doi:10.3390/e16042161

Quantifying Unique Information

Max Planck Institute for Mathematics in the Sciences, Inselstraße 23, 04109 Leipzig, Germany
Santa Fe Institute, 1399 Hyde Park Rd, Santa Fe, NM 87501, USA
Author to whom correspondence should be addressed.
Received: 15 January 2014 / Revised: 24 March 2014 / Accepted: 4 April 2014 / Published: 15 April 2014
View Full-Text   |   Download PDF [277 KB, uploaded 24 February 2015]   |  


We propose new measures of shared information, unique information and synergistic information that can be used to decompose the mutual information of a pair of random variables (Y, Z) with a third random variable X. Our measures are motivated by an operational idea of unique information, which suggests that shared information and unique information should depend only on the marginal distributions of the pairs (X, Y) and (X,Z). Although this invariance property has not been studied before, it is satisfied by other proposed measures of shared information. The invariance property does not uniquely determine our new measures, but it implies that the functions that we define are bounds to any other measures satisfying the same invariance property. We study properties of our measures and compare them to other candidate measures. View Full-Text
Keywords: Shannon information; mutual information; information decomposition; shared information; synergy Shannon information; mutual information; information decomposition; shared information; synergy

This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Bertschinger, N.; Rauh, J.; Olbrich, E.; Jost, J.; Ay, N. Quantifying Unique Information. Entropy 2014, 16, 2161-2183.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top