Next Article in Journal
Entropy, Age and Time Operator
Previous Article in Journal
Tsallis Distribution Decorated with Log-Periodic Oscillation
Open AccessLetter

On an Objective Basis for the Maximum Entropy Principle

Department of Electrical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
*
Author to whom correspondence should be addressed.
Entropy 2015, 17(1), 401-406; https://doi.org/10.3390/e17010401
Received: 26 September 2014 / Revised: 12 January 2015 / Accepted: 15 January 2015 / Published: 19 January 2015
(This article belongs to the Section Information Theory, Probability and Statistics)
In this letter, we elaborate on some of the issues raised by a recent paper by Neapolitan and Jiang concerning the maximum entropy (ME) principle and alternative principles for estimating probabilities consistent with known, measured constraint information. We argue that the ME solution for the “problematic” example introduced by Neapolitan and Jiang has stronger objective basis, rooted in results from information theory, than their alternative proposed solution. We also raise some technical concerns about the Bayesian analysis in their work, which was used to independently support their alternative to the ME solution. The letter concludes by noting some open problems involving maximum entropy statistical inference. View Full-Text
Keywords: maximum entropy; asymptotic equipartition principle maximum entropy; asymptotic equipartition principle
MDPI and ACS Style

Miller, D.J.; Soleimani, H. On an Objective Basis for the Maximum Entropy Principle. Entropy 2015, 17, 401-406.

Show more citation formats Show less citations formats

Article Access Map

1
Only visits after 24 November 2015 are recorded.
Back to TopTop