Next Article in Journal
Analysis of Solar Neutrino Data from Super-Kamiokande I and II
Next Article in Special Issue
Exact Test of Independence Using Mutual Information
Previous Article in Journal
Bayesian Test of Significance for Conditional Independence: The Multinomial Model
Previous Article in Special Issue
Information Flow in Animal-Robot Interactions
Entropy 2014, 16(3), 1396-1413; doi:10.3390/e16031396
Article

Infinite Excess Entropy Processes with Countable-State Generators

1,2,†,*  and 1,2,3,4
Received: 20 December 2013; in revised form: 24 February 2014 / Accepted: 5 March 2014 / Published: 10 March 2014
(This article belongs to the Special Issue Information in Dynamical Systems and Complex Systems)
View Full-Text   |   Download PDF [484 KB, uploaded 10 March 2014]   |   Browse Figures
Abstract: We present two examples of finite-alphabet, infinite excess entropy processes generated by stationary hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. These are the first explicit constructions of processes of this type.
Keywords: stationary stochastic process; hidden Markov model; epsilon-machine; ergodicity; entropy rate; excess entropy; mutual information stationary stochastic process; hidden Markov model; epsilon-machine; ergodicity; entropy rate; excess entropy; mutual information
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |
EndNote


MDPI and ACS Style

Travers, N.F.; Crutchfield, J.P. Infinite Excess Entropy Processes with Countable-State Generators. Entropy 2014, 16, 1396-1413.

AMA Style

Travers NF, Crutchfield JP. Infinite Excess Entropy Processes with Countable-State Generators. Entropy. 2014; 16(3):1396-1413.

Chicago/Turabian Style

Travers, Nicholas F.; Crutchfield, James P. 2014. "Infinite Excess Entropy Processes with Countable-State Generators." Entropy 16, no. 3: 1396-1413.


Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert