Next Article in Journal
Entropy, Age and Time Operator
Previous Article in Journal
Tsallis Distribution Decorated with Log-Periodic Oscillation
Article Menu

Export Article

Open AccessLetter
Entropy 2015, 17(1), 401-406; doi:10.3390/e17010401

On an Objective Basis for the Maximum Entropy Principle

Department of Electrical Engineering, The Pennsylvania State University, University Park, PA 16802, USA
*
Author to whom correspondence should be addressed.
Received: 26 September 2014 / Revised: 12 January 2015 / Accepted: 15 January 2015 / Published: 19 January 2015
(This article belongs to the Section Information Theory)
View Full-Text   |   Download PDF [175 KB, uploaded 24 February 2015]

Abstract

In this letter, we elaborate on some of the issues raised by a recent paper by Neapolitan and Jiang concerning the maximum entropy (ME) principle and alternative principles for estimating probabilities consistent with known, measured constraint information. We argue that the ME solution for the “problematic” example introduced by Neapolitan and Jiang has stronger objective basis, rooted in results from information theory, than their alternative proposed solution. We also raise some technical concerns about the Bayesian analysis in their work, which was used to independently support their alternative to the ME solution. The letter concludes by noting some open problems involving maximum entropy statistical inference. View Full-Text
Keywords: maximum entropy; asymptotic equipartition principle maximum entropy; asymptotic equipartition principle
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Miller, D.J.; Soleimani, H. On an Objective Basis for the Maximum Entropy Principle. Entropy 2015, 17, 401-406.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top