Open AccessThis article is
- freely available
A Free Energy Principle for Biological Systems
The Wellcome Trust Centre for Neuroimaging, Institute of Neurology, Queen Square, London, WC1N 3BG, UK
Received: 17 August 2012; in revised form: 1 October 2012 / Accepted: 25 October 2012 / Published: 31 October 2012
Abstract: This paper describes a free energy principle that tries to explain the ability of biological systems to resist a natural tendency to disorder. It appeals to circular causality of the sort found in synergetic formulations of self-organization (e.g., the slaving principle) and models of coupled dynamical systems, using nonlinear Fokker Planck equations. Here, circular causality is induced by separating the states of a random dynamical system into external and internal states, where external states are subject to random fluctuations and internal states are not. This reduces the problem to finding some (deterministic) dynamics of the internal states that ensure the system visits a limited number of external states; in other words, the measure of its (random) attracting set, or the Shannon entropy of the external states is small. We motivate a solution using a principle of least action based on variational free energy (from statistical physics) and establish the conditions under which it is formally equivalent to the information bottleneck method. This approach has proved useful in understanding the functional architecture of the brain. The generality of variational free energy minimisation and corresponding information theoretic formulations may speak to interesting applications beyond the neurosciences; e.g., in molecular or evolutionary biology.
Keywords: ergodicity; Bayesian; random dynamical system; self-organization; free energy; surprise
Citations to this Article
Cite This Article
MDPI and ACS Style
Karl, F. A Free Energy Principle for Biological Systems. Entropy 2012, 14, 2100-2121.
Karl F. A Free Energy Principle for Biological Systems. Entropy. 2012; 14(11):2100-2121.
Karl, Friston. 2012. "A Free Energy Principle for Biological Systems." Entropy 14, no. 11: 2100-2121.