Entropy 2014, 16(3), 1396-1413; doi:10.3390/e16031396

Infinite Excess Entropy Processes with Countable-State Generators

1,2,†,* email and 1,2,3,4email
Received: 20 December 2013; in revised form: 24 February 2014 / Accepted: 5 March 2014 / Published: 10 March 2014
(This article belongs to the Special Issue Information in Dynamical Systems and Complex Systems)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: We present two examples of finite-alphabet, infinite excess entropy processes generated by stationary hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. These are the first explicit constructions of processes of this type.
Keywords: stationary stochastic process; hidden Markov model; epsilon-machine; ergodicity; entropy rate; excess entropy; mutual information
PDF Full-text Download PDF Full-Text [484 KB, uploaded 10 March 2014 08:53 CET]

Export to BibTeX |

MDPI and ACS Style

Travers, N.F.; Crutchfield, J.P. Infinite Excess Entropy Processes with Countable-State Generators. Entropy 2014, 16, 1396-1413.

AMA Style

Travers NF, Crutchfield JP. Infinite Excess Entropy Processes with Countable-State Generators. Entropy. 2014; 16(3):1396-1413.

Chicago/Turabian Style

Travers, Nicholas F.; Crutchfield, James P. 2014. "Infinite Excess Entropy Processes with Countable-State Generators." Entropy 16, no. 3: 1396-1413.

Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert