Entropy 2014, 16(2), 968-989; doi:10.3390/e16020968
Article

Information Bottleneck Approach to Predictive Inference

email
Received: 3 June 2013; Accepted: 18 June 2013 / Published: 17 February 2014
(This article belongs to the Special Issue The Information Bottleneck Method)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: This paper synthesizes a recent line of work on automated predictive model making inspired by Rate-Distortion theory, in particular by the Information Bottleneck method. Predictive inference is interpreted as a strategy for efficient communication. The relationship to thermodynamic efficiency is discussed. The overall aim of this paper is to explain how this information theoretic approach provides an intuitive, overarching framework for predictive inference.
Keywords: predictive inference; information bottleneck method; dynamical systems; thermodynamic efficiency; far-from-equilibrium thermodynamics; computing engines
PDF Full-text Download PDF Full-Text [276 KB, Updated Version, uploaded 18 February 2014 14:45 CET]
The original version is still available [275 KB, uploaded 17 February 2014 10:44 CET]

Export to BibTeX |
EndNote


MDPI and ACS Style

Still, S. Information Bottleneck Approach to Predictive Inference. Entropy 2014, 16, 968-989.

AMA Style

Still S. Information Bottleneck Approach to Predictive Inference. Entropy. 2014; 16(2):968-989.

Chicago/Turabian Style

Still, Susanne. 2014. "Information Bottleneck Approach to Predictive Inference." Entropy 16, no. 2: 968-989.

Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert