Next Article in Journal
Bayesian Inference of Ecological Interactions from Spatial Data
Previous Article in Journal
Two-Party Zero-Error Function Computation with Asymmetric Priors
Previous Article in Special Issue
Secret Sharing and Shared Information
Article Menu
Issue 12 (December) cover image

Export Article

Open AccessArticle
Entropy 2017, 19(12), 636; doi:10.3390/e19120636

Analyzing Information Distribution in Complex Systems

Institute of Computer Science, University of Tartu, Ulikooli 17, 50090 Tartu, Estonia
Author to whom correspondence should be addressed.
Received: 21 July 2017 / Revised: 27 September 2017 / Accepted: 1 November 2017 / Published: 24 November 2017
View Full-Text   |   Download PDF [1379 KB, uploaded 24 November 2017]   |  


Information theory is often utilized to capture both linear as well as nonlinear relationships between any two parts of a dynamical complex system. Recently, an extension to classical information theory called partial information decomposition has been developed, which allows one to partition the information that two subsystems have about a third one into unique, redundant and synergistic contributions. Here, we apply a recent estimator of partial information decomposition to characterize the dynamics of two different complex systems. First, we analyze the distribution of information in triplets of spins in the 2D Ising model as a function of temperature. We find that while redundant information obtains a maximum at the critical point, synergistic information peaks in the disorder phase. Secondly, we characterize 1D elementary cellular automata rules based on the information distribution between neighboring cells. We describe several clusters of rules with similar partial information decomposition. These examples illustrate how the partial information decomposition provides a characterization of the emergent dynamics of complex systems in terms of the information distributed across their interacting units. View Full-Text
Keywords: information theory; partial information decomposition; Ising model; cellular automata information theory; partial information decomposition; Ising model; cellular automata

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Sootla, S.; Theis, D.O.; Vicente, R. Analyzing Information Distribution in Complex Systems. Entropy 2017, 19, 636.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top