Information Decomposition and Synergy
AbstractRecently, a series of papers addressed the problem of decomposing the information of two random variables into shared information, unique information and synergistic information. Several measures were proposed, although still no consensus has been reached. Here, we compare these proposals with an older approach to define synergistic information based on the projections on exponential families containing only up to k-th order interactions. We show that these measures are not compatible with a decomposition into unique, shared and synergistic information if one requires that all terms are always non-negative (local positivity). We illustrate the difference between the two measures for multivariate Gaussians. View Full-Text
Share & Cite This Article
Olbrich, E.; Bertschinger, N.; Rauh, J. Information Decomposition and Synergy. Entropy 2015, 17, 3501-3517.
Olbrich E, Bertschinger N, Rauh J. Information Decomposition and Synergy. Entropy. 2015; 17(5):3501-3517.Chicago/Turabian Style
Olbrich, Eckehard; Bertschinger, Nils; Rauh, Johannes. 2015. "Information Decomposition and Synergy." Entropy 17, no. 5: 3501-3517.