Next Article in Journal
Optimization of MIMO Systems Capacity Using Large Random Matrix Methods
Next Article in Special Issue
Function Identification in Neuron Populations via Information Bottleneck
Previous Article in Journal
Temperature Effects, Frieden–Hawkins’ Order-Measure, and Wehrl Entropy
Previous Article in Special Issue
The Mathematical Structure of Information Bottleneck Methods
Entropy 2012, 14(11), 2100-2121; doi:10.3390/e14112100
Article

A Free Energy Principle for Biological Systems

Received: 17 August 2012; in revised form: 1 October 2012 / Accepted: 25 October 2012 / Published: 31 October 2012
(This article belongs to the Special Issue The Information Bottleneck Method)
Download PDF [434 KB, uploaded 31 October 2012]
Abstract: This paper describes a free energy principle that tries to explain the ability of biological systems to resist a natural tendency to disorder. It appeals to circular causality of the sort found in synergetic formulations of self-organization (e.g., the slaving principle) and models of coupled dynamical systems, using nonlinear Fokker Planck equations. Here, circular causality is induced by separating the states of a random dynamical system into external and internal states, where external states are subject to random fluctuations and internal states are not. This reduces the problem to finding some (deterministic) dynamics of the internal states that ensure the system visits a limited number of external states; in other words, the measure of its (random) attracting set, or the Shannon entropy of the external states is small. We motivate a solution using a principle of least action based on variational free energy (from statistical physics) and establish the conditions under which it is formally equivalent to the information bottleneck method. This approach has proved useful in understanding the functional architecture of the brain. The generality of variational free energy minimisation and corresponding information theoretic formulations may speak to interesting applications beyond the neurosciences; e.g., in molecular or evolutionary biology.
Keywords: ergodicity; Bayesian; random dynamical system; self-organization; free energy; surprise ergodicity; Bayesian; random dynamical system; self-organization; free energy; surprise
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |
EndNote


MDPI and ACS Style

Karl, F. A Free Energy Principle for Biological Systems. Entropy 2012, 14, 2100-2121.

AMA Style

Karl F. A Free Energy Principle for Biological Systems. Entropy. 2012; 14(11):2100-2121.

Chicago/Turabian Style

Karl, Friston. 2012. "A Free Energy Principle for Biological Systems." Entropy 14, no. 11: 2100-2121.


Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert