Next Article in Journal
A Discrete Meta-Control Procedure for Approximating Solutions to Binary Programs
Next Article in Special Issue
Consistency and Generalization Bounds for Maximum Entropy Density Estimation
Previous Article in Journal
The Measurement of Information Transmitted by a Neural Population: Promises and Challenges
Previous Article in Special Issue
Relative Entropy Derivative Bounds
Entropy 2013, 15(9), 3528-3591; doi:10.3390/e15093528
Article

Objective Bayesianism and the Maximum Entropy Principle

 and *
Received: 28 June 2013; in revised form: 21 August 2013 / Accepted: 21 August 2013 / Published: 4 September 2013
(This article belongs to the Special Issue Maximum Entropy and Bayes Theorem)
Download PDF [732 KB, uploaded 4 September 2013]
Abstract: Objective Bayesian epistemology invokes three norms: the strengths of our beliefs should be probabilities; they should be calibrated to our evidence of physical probabilities; and they should otherwise equivocate sufficiently between the basic propositions that we can express. The three norms are sometimes explicated by appealing to the maximum entropy principle, which says that a belief function should be a probability function, from all those that are calibrated to evidence, that has maximum entropy. However, the three norms of objective Bayesianism are usually justified in different ways. In this paper, we show that the three norms can all be subsumed under a single justification in terms of minimising worst-case expected loss. This, in turn, is equivalent to maximising a generalised notion of entropy. We suggest that requiring language invariance, in addition to minimising worst-case expected loss, motivates maximisation of standard entropy as opposed to maximisation of other instances of generalised entropy. Our argument also provides a qualified justification for updating degrees of belief by Bayesian conditionalisation. However, conditional probabilities play a less central part in the objective Bayesian account than they do under the subjective view of Bayesianism, leading to a reduced role for Bayes’ Theorem.
Keywords: objective Bayesianism; g-entropy; generalised entropy; Bayesian conditionalisation; scoring rule; maximum entropy; maxent; minimax objective Bayesianism; g-entropy; generalised entropy; Bayesian conditionalisation; scoring rule; maximum entropy; maxent; minimax
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |
EndNote


MDPI and ACS Style

Landes, J.; Williamson, J. Objective Bayesianism and the Maximum Entropy Principle. Entropy 2013, 15, 3528-3591.

AMA Style

Landes J, Williamson J. Objective Bayesianism and the Maximum Entropy Principle. Entropy. 2013; 15(9):3528-3591.

Chicago/Turabian Style

Landes, Jürgen; Williamson, Jon. 2013. "Objective Bayesianism and the Maximum Entropy Principle." Entropy 15, no. 9: 3528-3591.


Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert