Next Article in Journal
"Information Theory and its Applications to Biology, Finance and Physics" at the Stefan Banach International Mathematical Center (Warsaw, Poland), May 21-26, 2001
Previous Article in Journal
A Cellular Automata Study of Constraints (Dissolvence) in a Percolating Many-Particle System
Entropy 2001, 3(2), 58-63; doi:10.3390/e3020058
Article

Maximum Entropy: Clearing up Mysteries

Jr. *  and
Received: 29 November 2000 / Accepted: 31 March 2001 / Published: 8 April 2001
Download PDF [96 KB, uploaded 24 February 2015]

Abstract

There are several mystifications and a couple of mysteries pertinent to MaxEnt. The mystifications, pitfalls and traps are set up mainly by an unfortunate formulation of Jaynes' die problem, the cause célèbre of MaxEnt. After discussing the mystifications a new formulation of the problem is proposed. Then we turn to the mysteries. An answer to the recurring question 'Just what are we accomplishing when we maximize entropy?' [8], based on MaxProb rationale of MaxEnt [6], is recalled. A brief view on the other mystery: 'What is the relation between MaxEnt and the Bayesian method?' [9], in light of the MaxProb rationale of MaxEnt suggests that there is not and cannot be a conflict between MaxEnt and Bayes Theorem.
Keywords: maximum entropy; maximum probability; Jaynes' die problem; maximum likelihood; minimax entropy maximum entropy; maximum probability; Jaynes' die problem; maximum likelihood; minimax entropy
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Share & Cite This Article

Further Mendeley | CiteULike
Export to BibTeX |
EndNote
MDPI and ACS Style

Grendár, M., Jr.; Grendár, M. Maximum Entropy: Clearing up Mysteries. Entropy 2001, 3, 58-63.

View more citation formats

Article Metrics

Comments

Citing Articles

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert