Next Article in Journal
Prediction Method for Image Coding Quality Based on Differential Information Entropy
Previous Article in Journal
The Elusive Nature of Entropy and Its Physical Meaning
Previous Article in Special Issue
Consideration on Singularities in Learning Theory and the Learning Coefficient
Open AccessArticle

Information Bottleneck Approach to Predictive Inference

Information and Computer Sciences Department, University of Hawaii at Mānoa, Honolulu, HI 96822, USA
Entropy 2014, 16(2), 968-989; https://doi.org/10.3390/e16020968
Received: 3 June 2013 / Accepted: 18 June 2013 / Published: 17 February 2014
(This article belongs to the Special Issue The Information Bottleneck Method)
This paper synthesizes a recent line of work on automated predictive model making inspired by Rate-Distortion theory, in particular by the Information Bottleneck method. Predictive inference is interpreted as a strategy for efficient communication. The relationship to thermodynamic efficiency is discussed. The overall aim of this paper is to explain how this information theoretic approach provides an intuitive, overarching framework for predictive inference. View Full-Text
Keywords: predictive inference; information bottleneck method; dynamical systems; thermodynamic efficiency; far-from-equilibrium thermodynamics; computing engines predictive inference; information bottleneck method; dynamical systems; thermodynamic efficiency; far-from-equilibrium thermodynamics; computing engines
MDPI and ACS Style

Still, S. Information Bottleneck Approach to Predictive Inference. Entropy 2014, 16, 968-989.

Show more citation formats Show less citations formats

Article Access Map by Country/Region

1
Only visits after 24 November 2015 are recorded.
Search more from Scilit
 
Search
Back to TopTop