Information Decomposition and Synergy
AbstractRecently, a series of papers addressed the problem of decomposing the information of two random variables into shared information, unique information and synergistic information. Several measures were proposed, although still no consensus has been reached. Here, we compare these proposals with an older approach to define synergistic information based on the projections on exponential families containing only up to k-th order interactions. We show that these measures are not compatible with a decomposition into unique, shared and synergistic information if one requires that all terms are always non-negative (local positivity). We illustrate the difference between the two measures for multivariate Gaussians. View Full-Text
Scifeed alert for new publicationsNever miss any articles matching your research from any publisher
- Get alerts for new papers matching your research
- Find out the new papers from selected authors
- Updated daily for 49'000+ journals and 6000+ publishers
- Define your Scifeed now
Olbrich, E.; Bertschinger, N.; Rauh, J. Information Decomposition and Synergy. Entropy 2015, 17, 3501-3517.
Olbrich E, Bertschinger N, Rauh J. Information Decomposition and Synergy. Entropy. 2015; 17(5):3501-3517.Chicago/Turabian Style
Olbrich, Eckehard; Bertschinger, Nils; Rauh, Johannes. 2015. "Information Decomposition and Synergy." Entropy 17, no. 5: 3501-3517.