Next Article in Journal
Energy Dissipation and Information Flow in Coupled Markovian Systems
Next Article in Special Issue
Entropy Power, Autoregressive Models, and Mutual Information
Previous Article in Journal
Spatial Organization of Five-Fold Morphology as a Source of Geometrical Constraint in Biology
Previous Article in Special Issue
Fixed-Rate Universal Lossy Source Coding and Model Identification: Connection with Zero-Rate Density Estimation and the Skeleton Estimator
Open AccessReview

Information Theory and Cognition: A Review

Department of Electrical and Computer Engineering, University of Nebraska, Lincoln, NE 68588-0511, USA
Entropy 2018, 20(9), 706;
Received: 24 June 2018 / Revised: 31 August 2018 / Accepted: 8 September 2018 / Published: 14 September 2018
(This article belongs to the Special Issue Rate-Distortion Theory and Information Theory)
We examine how information theory has been used to study cognition over the last seven decades. After an initial burst of activity in the 1950s, the backlash that followed stopped most work in this area. The last couple of decades has seen both a revival of interest, and a more firmly grounded, experimentally justified use of information theory. We can view cognition as the process of transforming perceptions into information—where we use information in the colloquial sense of the word. This last clarification is one of the problems we run into when trying to use information theoretic principles to understand or analyze cognition. Information theory is mathematical, while cognition is a subjective phenomenon. It is relatively easy to discern a subjective connection between cognition and information; it is a different matter altogether to apply the rigor of information theory to the process of cognition. In this paper, we will look at the many ways in which people have tried to alleviate this problem. These approaches range from narrowing the focus to only quantifiable aspects of cognition or borrowing conceptual machinery from information theory to address issues of cognition. We describe applications of information theory across a range of cognition research, from neural coding to cognitive control and predictive coding. View Full-Text
Keywords: information theory; cognition; neuronal codes; average mutual information; predictive coding information theory; cognition; neuronal codes; average mutual information; predictive coding
Show Figures

Figure 1

MDPI and ACS Style

Sayood, K. Information Theory and Cognition: A Review. Entropy 2018, 20, 706.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Back to TopTop