Information 2013, 4(1), 1-30; doi:10.3390/info4010001
Article

Complexity over Uncertainty in Generalized Representational Information Theory (GRIT): A Structure-Sensitive General Theory of Information

Center for the Advancement of Cognitive Science, Ohio University, 318 Porter Hall, Athens, OH 45701, USA
Received: 9 August 2012; in revised form: 12 November 2012 / Accepted: 12 December 2012 / Published: 20 December 2012
(This article belongs to the Special Issue Information: Its Different Modes and Its Relation to Meaning)
PDF Full-text Download PDF Full-Text [350 KB, Updated Version, uploaded 7 January 2013 16:00 CET]
The original version is still available [336 KB, uploaded 20 December 2012 16:26 CET]
Abstract: What is information? Although researchers have used the construct of information liberally to refer to pertinent forms of domain-specific knowledge, relatively few have attempted to generalize and standardize the construct. Shannon and Weaver (1949) offered the best known attempt at a quantitative generalization in terms of the number of discriminable symbols required to communicate the state of an uncertain event. This idea, although useful, does not capture the role that structural context and complexity play in the process of understanding an event as being informative. In what follows, we discuss the limitations and futility of any generalization (and particularly, Shannon’s) that is not based on the way that agents extract patterns from their environment. More specifically, we shall argue that agent concept acquisition, and not the communication of states of uncertainty, lie at the heart of generalized information, and that the best way of characterizing information is via the relative gain or loss in concept complexity that is experienced when a set of known entities (regardless of their nature or domain of origin) changes. We show that Representational Information Theory perfectly captures this crucial aspect of information and conclude with the first generalization of RIT to continuous domains.
Keywords: information theory; representational information; categorization; concepts; invariance; complexity; information measure; subjective information

Correction

Article Statistics

Load and display the download statistics.

Citations to this Article

Cite This Article

MDPI and ACS Style

Vigo, R. Complexity over Uncertainty in Generalized Representational Information Theory (GRIT): A Structure-Sensitive General Theory of Information. Information 2013, 4, 1-30.

AMA Style

Vigo R. Complexity over Uncertainty in Generalized Representational Information Theory (GRIT): A Structure-Sensitive General Theory of Information. Information. 2013; 4(1):1-30.

Chicago/Turabian Style

Vigo, Ronaldo. 2013. "Complexity over Uncertainty in Generalized Representational Information Theory (GRIT): A Structure-Sensitive General Theory of Information." Information 4, no. 1: 1-30.

Information EISSN 2078-2489 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert