Justifying Objective Bayesianism on Predicate Languages

Abstract

Objective Bayesianism says that the strengths of one’s beliefs ought to be probabilities, calibrated to physical probabilities insofar as one has evidence of them, and otherwise sufficiently equivocal. These norms of belief are often explicated using the maximum entropy principle. In this paper we investigate the extent to which one can provide a unified justification of the objective Bayesian norms in the case in which the background language is a first-order predicate language, with a view to applying the resulting formalism to inductive logic. We show that the maximum entropy principle can be motivated largely in terms of minimising worst-case expected loss.

1. Introduction

Objective Bayesianism holds that the strengths of one’s beliefs should satisfy three norms [1,2]:

• Probability. The strengths of one’s beliefs should satisfy the axioms of probability: if bel is one’s belief function, which assigns a degree of belief to each sentence of one’s language, then bel ∈ ℙ, the set of probability functions defined on the sentences of one’s language.
• Calibration. The strengths of one’s beliefs should fit one’s evidence: bel ∈ $\mathbb{E}$, the set of belief functions compatible with one’s evidence. In particular, the strengths of one’s beliefs should be calibrated with physical probabilities, insofar as one has evidence as to what the physical probabilities are: if one’s evidence determines just that the physical probability function P^* lies in some non-empty set ℙ^* of probability functions, then bel ∈ $\mathbb{E}$ = 〈ℙ^*〉, where 〈ℙ^*〉 is the convex hull of ℙ^* [3].
• Equivocation. The strengths of one’s beliefs should otherwise equivocate sufficiently between the basic possibilities that one can express: bel is some function in E that is sufficiently equivocal. Note that entropy is often used as a measure of the extent to which a probability function equivocates.

These three norms are usually justified in rather different ways. The Probability norm is usually justified as being required if one is to avoid sure loss—the Dutch book argument. The Calibration norm needs to hold if one is to avoid loss in the long run when one repeatedly bets on similar events. It has also been argued that the Equivocation norm should hold if one is to minimise worst-case expected loss. See Williamson [1] (Chapter 3) for discussion of these justifications. Unfortunately, these justifications do not cohere particularly well, because the betting set-up and the notion of loss differ in each case—for the Probability norm, the notion of loss is sure single-case loss, where losses may be positive or negative; for the Calibration norm it is almost-sure (i.e., probability 1) long-run loss, positive or negative; for the Equivocation norm, it is worst-case expected loss, where the loss is positive and logarithmic. Furthermore, a justification for the order in which the norms are applied is missing. In particular, the justification of the Equivocation norm presumes that belief is probabilistic; for this justification to work, some argument is needed for the claim that avoiding sure loss should be prioritised over minimising worst-case expected loss; but there is as yet no such argument. The question thus arises as to whether a single, unified justification can be given for the three norms, in order to circumvent the above problems.

Landes and Williamson [4] provided a single, unified justification for the situation in which one’s beliefs are defined over propositions, construed as subsets of a finite set Ω of outcomes. It turns out that all three norms must hold if one is to minimise worst-case expected loss: one’s belief function should be a probability function in $\mathbb{E}$ = 〈ℙ^*〉 that has sufficiently high entropy. This line of argument will be described in Section 2. Landes and Williamson [4] went on to extend this unified justification to the situation in which beliefs are defined over sentences of a propositional language, formed by recursively applying the usual propositional connectives ¬, ˄, ˅, →, ↔ to a finite set of propositional variables.

In this paper we shall show that a similar justification goes through for the situation in which beliefs are defined over sentences of a first-order predicate language, with the use of predicate, constant and variable symbols as well as the quantifiers ∀, ∃. In Section 3 we shall formulate the norms of objective Bayesianism in the context of a predicate language. In Section 4 we shall provide a justification for maximising entropy when the language in question is a predicate language without quantifier symbols and when the evidence set is finitely generated. In Section 5, we shall extend this line of argument to predicate languages that contain quantifier symbols. In Section 6 we shall investigate the case of evidence which is not finitely generated. Key concepts and notation are collected in Appendix C for ease of reference.

The key technical results in this paper are Theorem 3, Theorem 6, Theorem 7, and Theorem 8. These results all suppose that the available evidence is finitely generated (in the sense of Definition 5). The first two jointly show that, on a quantifier-free predicate language, the belief function with the best loss profile is the calibrated probability function which has maximal entropy. Theorem 7 implies that adding new constant or predicate symbols to the language does not change the inferences one draws which are expressible in the original language. Theorem 8 extends Theorem 3 and Theorem 6 to predicate languages with quantifiers. En route to proving Theorem 8, we improve on Gaifman’s Unique Extension Theorem [5] (Theorem 1) in Proposition 24.

The case of evidence which cannot be finitely generated is more involved. We consider a case in which no belief function has an optimal loss profile in Proposition 28 and Proposition 30. While there are no functions with the best loss profile in that case, we show in Proposition 29 and Proposition 31 that probability functions in a neighbourhood of the calibrated function with maximal entropy have arbitrarily good loss profiles. We also discuss a case in which the belief function with best loss profile does indeed turn out to be the calibrated probability function which has maximal entropy, see Theorem 9.

2. Beliefs over Propositions

Here we will recap the relevant results of Landes and Williamson [4], to which the reader is referred for further details and motivation. In this section we will be concerned solely with a finite set Ω of possible outcomes. We shall suppose that each member ω of Ω is a state ±A₁ ˄…˄ ±A_n of a finite propositional language L = {A₁,∆, A_n}. A proposition F is a subset of Ω. Let Π be the set of all partitions of Ω. We take {∅, Ω}, {Ω} ∈ Π. In order to limit the proliferation of partitions, we suppose that the only partition in which ∅ occurs is {∅, Ω}.

Given a belief function bel : $\mathcal{P}\mathrm{\Omega }\to {\mathrm{ℝ}}_{\ge }{}_0$ that is not zero everywhere, we normalise by dividing each degree of belief by ${\max }_{\pi }{{}_{\in }}_{\mathrm{\Pi }}{\sum }_{F\in \pi }bel\left(F\right)$ to form a belief function, B : $\mathcal{P}\mathrm{\Omega }\to \left[0,1\right]$, with degrees of belief in the unit interval. The set of normalised belief functions is

$$\mathbb{B}:=\{B:\mathcal{P}\mathrm{\Omega }\to [0,1]:{\displaystyle \sum _{F\in \pi }B(F)\le 1\text{for all}\pi \in \mathrm{\Pi }\mathrm{and}}{\displaystyle \sum _{F\in \pi }B(F)=1\text{for some}\pi }\}.$$

On the other hand, the set of probability functions is

$$\mathrm{\mathbb{P}}:=\{B:\mathcal{P}\mathrm{\Omega }\to [0,1]:{\displaystyle \sum _{F\in \pi }B(F)=1\text{for all}\pi \in \mathrm{\Pi }\}\cup \mathbb{B},}$$

where ⊂ denotes strict subset inclusion. The inclusion is strict since the following normalised belief function B is not in ℙ, B(∅) = 1 and B(F ) = 0 for all ∅ ⊂ F ⊆ Ω. Since {Ω} is a partition we have P (Ω) = 1 and since {Ω, ∅} is a partition it holds that P (∅) = 0 for all P ∈ ℙ.

Let L(F, B) be the loss incurred by adopting belief function B when proposition F turns out to be true. Arguably, in the absence of knowledge of the true loss function, the loss function L should be taken to be logarithmic, as we shall now see. Consider the following four conditions on a default loss function L:

• L1. L(F, B) = 0 if B(F ) = 1.
• L2. L(F, B) strictly increases as B(F) decreases from 1 towards 0.
• L3. L(F, B) depends only on B(F), not on B(F ⁰) for F ⁰ 6= F.
  To express the next condition we need some notation. Suppose $\mathrm{ℒ}={\mathrm{ℒ}}_1\cup {\mathrm{ℒ}}_2$: say that $\mathrm{ℒ}=\{A_1,\dots ,A_n\},{\mathrm{ℒ}}_1=\{A_1,\dots ,A_m\},{\mathrm{ℒ}}_2=\{A_m{}_{+1},\dots ,A_n\}$ for some 1 ≤ m < n. Then ω ∈ Ω takes the form ω₁ ˄ ω₂ where ω₁ ∈ Ω₁ is a state of ${\mathrm{ℒ}}_1$, and ω₂ ∈ Ω₂ is a state of ${\mathrm{ℒ}}_2$. Given propositions F₁ ⊆ Ω₁ and F₂ ⊆ Ω₂ we can define F₁ × F₂ := {ω = ω₁ ˄ ω₂ : ω₁ ∈ F₁, ω₂ ∈ F₂}, a proposition of $\mathrm{ℒ}$. Given a fixed belief function B such that B(Ω) = 1, ${\mathrm{ℒ}}_1$ and ${\mathrm{ℒ}}_2$ are independent sublanguages, written ${\mathrm{ℒ}}_1{╨}_B{\mathrm{ℒ}}_2$, if B(F₁ × F₂) = B(F₁) · B(F₂) for all F₁ ⊆ Ω₁ and F₂ ⊆ Ω₂, where B(F₁) := B(F₁ × Ω₂) and B(F₂) := B(Ω₁ × F₂). The restriction $B_{\downharpoonright }{}_{\mathrm{ℒ}1}$ of B to ${\mathrm{ℒ}}_1$ is a belief function on ${\mathrm{ℒ}}_1$ defined by $B_{\downharpoonright }{}_{\mathrm{ℒ}1}\left(F_1\right)=B\left(F_1\right)=B\left(F_1\times {\mathrm{\Omega }}_2\right)$, and similarly for ${\mathrm{ℒ}}_2$.
• L4. Losses are additive when the language is composed of independent sublanguages: if $\mathrm{ℒ}={\mathrm{ℒ}}_1\cup {\mathrm{ℒ}}_2$ for ${\mathrm{ℒ}}_1{╨}_B{\mathrm{ℒ}}_2$, then $L\left(F_1\times F_2,B\right)=L_1\left(F_1,B_{\downharpoonright {\mathrm{ℒ}}_1}\right)+L_2\left(F_2,B_{{\mathrm{ℒ}}_2}\right)$, where L₁, L₂ are loss functions defined on ${\mathrm{ℒ}}_1$, ${\mathrm{ℒ}}_2$ respectively.

Theorem 1. If a loss function L satisfies L1–4 then L(F, B) = −k log B(F) for some constant k > 0 that does not depend on$\mathrm{ℒ}$.

When we consider the notion of expected loss, we see that this concept depends on the weight given to the various partitions under consideration. Let g : Π → ℝ_≥0 be a function that assigns a weight to each partition. Then the g-expected loss or g-score of a belief function $B\in \mathbb{B}$ with respect to a probability function P ∈ ℙ is defined by

$$S_g^L(P,B):={\displaystyle \sum _{\pi \in \mathrm{\Pi }}g(\pi ){\displaystyle \sum _{F\in \pi }P(F)L(F,B),}}$$

for any weighting function g that is inclusive in the sense that for any proposition F, some partition π containing F is given positive weight. We adopt the usual convention that 0 log 0 = 0. This ensures that $S_g^L\left(P,B\right)$ is well-defined. Theorem 1 allows us to focus attention on logarithmic g-score,

$$S_g(P,B):=-{\displaystyle \sum _{\pi \in \mathrm{\Pi }}g(\pi )}{\displaystyle \sum _{F\in \pi }P(F)\log B(F)}.$$

(1)

An important property of a scoring rule is that $\arg {\inf }_{B\in \mathbb{B}}{S}_g^L\left(P,B\right)=\{P\}$ for all P ∈ ℙ. That is, for fixed P ∈ ℙ, $S_g^L\left(P,B\right)$ is uniquely minimised by B = P. This property is known as strict propriety.

Proposition 1 (Strict Propriety). S_g is strictly proper.

By analogy with the generalised notion of scoring rule, we get a similar generalisation of entropy, g-entropy:

$$H_g(B):=-{\displaystyle \sum _{\pi \in \mathrm{\Pi }}g(\pi )}{\displaystyle \sum _{F\in \pi }B(F)\log B(F)}.$$

(2)

The standard entropy function corresponds to the special case in which g = g_Ω, the (non-inclusive) weighting function that gives weight 1 to the partition {{ω} : ω ∈ Ω} of states and weight 0 to all other partitions.

It turns out that, if there is such a function, the probability function that minimises worst-case g-score, where the worst case is taken over physical probability functions in the set $\mathbb{E}=\langle {\mathrm{\mathbb{P}}}^{*}\rangle$, is the probability function in $\mathbb{E}$ that has maximum g-entropy:

Theorem 2. As noted above, $\mathbb{E}$ is taken to be convex and g inclusive. There is a unique member of${\text{arg sup}}_P{{}_{\in }}_{\mathbb{E}}Hg\left(P\right)$, which we shall denote by$P_g^{†}$. Furthermore,

$$\arg \underset{P\in \mathbb{E}}{\sup }{H}_g\left(P\right)=\arg \underset{B\in \mathbb{B}}{\inf }\underset{P\in \mathbb{E}}{\sup }{S}_g\left(P,B\right)=\{P_g^{†}\}.$$

Throughout this paper we use ${\text{arg sup}}_{P\in \mathbb{E}}$ (and ${\text{arg inf}}_{P\in \mathbb{E}}$) to refer to the points in the closure [ $\mathbb{E}$] of $\mathbb{E}$ that achieve the supremum (respectively infimum) whether or not these points are in$\mathbb{E}$. (This convention shall also apply mutatis mutandis to suprema and infima over sets of belief functions defined on predicate languages later in this paper.)

The above theorem concerns the minimisation of worst-case g-score. If one replaces the minimisation of worst-case g-score by a more fine-grained criterion (which breaks ties between belief functions with the same worst-case g-score), then an analogue of the above theorem holds: there exists a unique belief function which is best with respect to this criterion and this function is $P_g^{†}$, which maximises g-score in [ $\mathbb{E}$]. When we move to predicate languages we will consider such a refinement in Definition 21.

3. Beliefs over Sentences of a Predicate Language

3.1. Norms

In this section we introduce the norms of objective Bayesianism as they apply to strength of belief in sentences formulated in a predicate language. This framework is presented in more detail in Williamson [1] (Chapter 5). It is this set of norms that we seek to justify in terms of the loss that a belief function exposes one to.

We shall take $\mathrm{ℒ}$ to be a first-order predicate language with finitely many relation symbols U₁, …, U_s, countably many constant symbols t₁, t₂, …, but no function or equality symbols. We will consider languages with and without the existential quantifier symbol, using the notation ${\mathrm{ℒ}}^{\nexists }$ and ${\mathrm{ℒ}}^{\exists }$ to disambiguate where needed. We shall assume, as is usual in this setting, that each individual in the domain of discourse is picked out by a some constant symbol. The sentences $S\mathrm{ℒ}$ of $\mathrm{ℒ}$ are formed by recursively applying the usual connectives and the existential quantifier, if present. In $\mathrm{ℒ}={\mathrm{ℒ}}^{\exists }$, universally quantified sentences may be defined in terms of existentially quantified sentences as usual via ∀xθ(x) := ¬∃x¬θ(x). Note that $S{\mathrm{ℒ}}^{\nexists }$ coincides with the set of quantifier-free sentences of ${\mathrm{ℒ}}^{\exists }$. We shall also be interested in the finite sublanguages ${\mathrm{ℒ}}_n$, for n≥1, which are identical to $\mathrm{ℒ}$ except that they have only finitely many constant symbols t₁, …, t_n.

We shall list the atomic sentences of $\mathrm{ℒ}$, i.e., sentences of the form Ut where U is a relation symbol and t is a tuple of constant symbols of the corresponding arity, as A₁, A₂, …, ordered in such a way that atomic sentences that can be expressed in ${\mathrm{ℒ}}_n{}_{+1}$ but not in ${\mathrm{ℒ}}_n$ occur after the atomic sentences A₁, …, A_rn of ${\mathrm{ℒ}}_n$, for each n. Ω_n will denote the set of n-states, i.e., sentences of the form $\pm A_1\wedge \cdots \wedge \pm A_{r_n}$. We shall use Greek letters, such as θ, to denote sentences of $\mathrm{ℒ}$, and Roman letters, e.g., F, to denote propositions expressed by such sentences. We shall construe propositions as sets of n-states, F ⊆ Ω_n for some n (see Section 2).

The norms of objective Bayesianism can then be explicated thus:

Probability. The strengths of one’s beliefs should be representable by a probability function, i.e., a function $P:S\mathrm{ℒ}\to \mathrm{ℝ}$ that satisfies the properties:

• P1. P (τ) = 1 for all tautologies τ.
• P2. If ⊨¬(φ ˄ ψ) then P (φ ˅ ψ) = P (φ) + P (ψ).
• P3.$P(\exists x\theta (x))={\sup }_{m}P\left({\vee }_{i=1}^m\theta \left(t_i\right)\right)$.

(Clearly P3 is only applicable in the case $\mathrm{ℒ}={\mathrm{ℒ}}^{\exists }$.)

Calibration. One’s degrees of belief should satisfy constraints imposed by one’s evidence. Assuming all evidence is evidence of physical probabilities, P should lie in the set ${\mathbb{E}}_L=\langle {\mathrm{\mathbb{P}}}^{*}\rangle$, the convex hull of the set of epistemically possible physical probability functions.

Equivocation. One’s degrees of belief should otherwise be sufficiently equivocal. Again, one can explicate this by saying that one’s belief function should have sufficiently high entropy. Here P has higher entropy than Q if there is some N such that for all n≥N, $H_{\mathrm{\Omega }}^n\left(P\right)>H_{\mathrm{\Omega }}^n\left(Q\right)$, where $H_{\mathrm{\Omega }}^n$is standard entropy on ${\mathrm{ℒ}}_n$, $H_{\mathrm{\Omega }}^n\left(P\right):=-{\sum }_{\omega \in {\mathrm{\Omega }}_n}P\left(\omega \right)\log P\left(\omega \right)$.

The key question we attempt to answer here is: can these norms be given a unified justification in terms of avoiding avoidable loss?

3.2. Belief and Probability

A (non-normalised) belief function bel : $S\mathrm{ℒ}\to {\mathrm{ℝ}}_{\ge }{}_0$ is a function that maps any sentence of the language to a non-negative real number. For technical convenience we shall focus our attention on normalised belief functions, which are defined below.

A (countable) set of mutually exclusive sentences $\pi \subset S\mathrm{ℒ}$ is called exhaustive if, for all interpretations $\mathrm{ℐ}$ under which the constants exhaust the universe of $\mathrm{ℳ}$, there exists a sentence θ ∈ π such that $\mathrm{ℐ}\models \theta$. This means that it is not possible for all θ ∈ π to be false at the same time. In order to control the number of partitions, we shall assume that the only partitions in which contradictions κ occur are the partitions of the form {τ, κ}, for some tautology τ. Let ${\mathrm{\Pi }}_{\mathrm{ℒ}}$ denote the set of partitions of $\mathrm{ℒ}$.

Example 1 (Infinite partitions). Even though${\mathrm{ℒ}}^{\exists }$ does not contain a symbol for equality and every element of a partition is a sentence of${\mathrm{ℒ}}^{\exists }$, which is of finite length, infinite partitions such as the following do exist:

$${\pi }_{\mathrm{\infty }}:=\{\forall x\neg U_{1}x\}\cup {\displaystyle \underset{k=1}{\overset{\mathrm{\infty }}{\cup }}\{U_1{t}_k\wedge \underset{l=1}{\overset{k-1}{\wedge }}\neg U_1{t}_l\}}.$$

(Here it is presupposed that${\mathrm{ℒ}}^{\exists }$ contains a unary predicate symbol U₁.) On the other hand, it turns out that there are no infinite partitions in${\mathrm{ℒ}}^{\nexists }$ [6] (§2.5).

We take it that it is a matter of convention on which scale beliefs are measured. For convenience, we want to normalise this scale to the unit interval, [0, 1], so that all belief functions are considered on the same scale.

Definition 1 (Normalised belief function). Let$M:={\sup }_{\pi \in {\mathrm{\Pi }}_{\mathrm{ℒ}}}{\sum }_{\phi \in \pi }bel(\phi )$. Then define the normalisation of bel as$B(\phi ):=\frac{bel(\phi )}{M}$, if M > 0. For a function f assigning every$\phi \in S\mathrm{ℒ}$ the same value v ∈ ℝ_≥0 we write f ≡ v. We shall consider bel ≡ 0 as normalised. The set of normalized belief functions on$S\mathrm{ℒ}$ then is

$$\begin{array}{l}{B}_{\mathrm{ℒ}}:=\{B:S\mathrm{ℒ}\to [0,1]:\}{\displaystyle \sum _{\phi \in \pi }B(\phi )\le 1forall\pi \in {\mathrm{\Pi }}_{\mathrm{ℒ}}and{\displaystyle \sum _{\phi \in \pi }B(\phi )=1forsome\pi \in {\mathrm{\Pi }}_{\mathrm{ℒ}}\}}}\\ \cup \{B\equiv 0\}.\end{array}$$

For the normalisation of bel, B, it holds that B ≡ 0, if and only if M = +∞ or bel ≡ 0.

We will be particularly interested in the following subset of functions:

$${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:=\{P:S\mathrm{ℒ}\to \left[0,1\right]:{\displaystyle \sum _{\phi \in \pi }P}(\phi )=1\text{for all}\pi \in {\mathrm{\Pi }}_{\mathrm{ℒ}}\}.$$

These are the probability functions:

Proposition 2.$P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$, if and only if$P:S\mathrm{ℒ}\to \left[0,1\right]$ satisfies the axioms of probability:

• P1. P (τ) = 1 for all tautologies$\tau \in S\mathrm{ℒ}$.
• P2. If ⊨ ¬(φ ˄ ψ) then P (φ ˅ ψ) = P (φ) + P (ψ).
• P3.$P(\exists x\theta (x))={\sup }_{m}P\left({\vee }_{i=1}^m\theta \left(t_i\right)\right)$.

Proof. First we shall see that $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ satisfies the axioms of probability.

• P1. For any tautology τ ∈ SL it holds that P (τ) = 1 because {τ} is a partition in Π_L. P (κ) = 0 for all contradictions κ because {τ, κ} is a partition in Π_L and P (τ) = 1.
• P2. Suppose that φ, $\psi \in S\mathrm{ℒ}$ are such that ⊨ ¬(φ ˄ ψ). We shall proceed by cases to show that P (φ ˅ ψ) = P (φ) + P (ψ). In the first three cases one of the sentences is a contradiction, in the last two cases there are no contradictions.

  • φ and ⊨ ¬ψ, then ⊨ φ ˅ ψ. Thus by the above P (φ) = 1 and P (ψ) = 0 and hence P (φ ˅ ψ) = 1 = P (φ) + P (ψ).
  • ⊨ ¬φ and ⊨ ¬ψ, then ⊨ ¬φ ˄ ¬ψ. Thus P (φ ˅ ψ) = 0 = P (φ) + P (ψ).
  • ⊭ ¬φ, ⊭ φ, and ⊨ ¬ψ, then {φ ˅ ψ, ¬φ ˅ ψ} and {φ, ¬φ ˅ ψ} are both partitions in ${\mathrm{\Pi }}_{\mathrm{ℒ}}$. Thus P (φ ˅ ψ) + P (¬φ ˅ ψ) = 1 = P (φ) + P (¬φ ˅ ψ). Putting these observations together we now find P (φ ˅ ψ) = P (φ) = P (φ) + P (ψ).
  • ⊭ ¬φ, ⊭ ¬ψ and ⊨ φ ↔ ¬ψ, then {φ, ψ} is a partition and φ ˅ ψ is a tautology. Hence, P (φ) + P (ψ) = 1 and P (φ ˅ ψ) = 1. This now yields P (φ) + P (ψ) = P (φ ˅ ψ).
  • ⊭ ¬φ, ⊭ ¬ψ and ⊭ φ ↔ ¬ψ, then none of the following sentences is a tautology or a contradiction φ, ψ, φ˅ψ, ¬(φ˅ψ). Since {φ, ψ, ¬(φ˅ψ)} and {φ˅ψ, ¬(φ˅ψ)} are both partitions in Π_L we obtain P (φ) + P (ψ) = 1 − P (¬(φ ˅ ψ)) = P (φ ˅ ψ). So P (φ) + P (ψ) = P (φ ˅ ψ).
• P3. For the rest of this proof we only have to consider $\mathrm{ℒ}={\mathrm{ℒ}}^{\exists }$.

If ⊨ ∃xθ(x), then P (∃xθ(x)) = 1.

Furthermore, the set {θ_n : n ∈ ℕ} with ${\theta }_n:=\theta (t_n)\wedge {{\displaystyle \wedge }}_{j=1}^{n-1}\neg \theta (t_j)$ is exhaustive. Note that $\models {{\displaystyle \vee }}_{i=1}^n\theta (t_i)\leftrightarrow {{\displaystyle \vee }}_{i=1}^n{\theta }_i$. P1 and P2 are well-known to imply that logically equivalent sentences are assigned the same probability; see [7] (Proposition 2.1.c). Hence, $P({{\displaystyle \vee }}_{i=1}^n\theta (t_i))=P({{\displaystyle \vee }}_{i=1}^n{\theta }_i)$.

The θ_i are mutually exclusive. We obtain from P2 that $P({{\displaystyle \vee }}_{i=1}^n{\theta }_i)={\sum }_{i=1}^{n}P({\theta }_i)$. Next, define a set Θ := {θ_n : θ_n satisfiable} which consists of exhaustive, satisfiable and mutually exclusive sentences. Hence Θ is a partition in ${\mathrm{\Pi }}_{\mathrm{ℒ}}$. We finally obtain

$$1={\displaystyle \sum _{\theta \in \mathrm{\Theta }}P(\theta )\le \underset{n\to \mathrm{\infty }}{\lim }}{\displaystyle \sum _{i=1}^{n}P({\theta }_n)=\underset{n\to \mathrm{\infty }}{\lim }}P(\underset{i=1}{\overset{n}{{\displaystyle \vee }}}{\theta }_i)=\underset{n\to \mathrm{\infty }}{\lim }P(\underset{i=1}{\overset{n}{{\displaystyle \vee }}}\theta (t_i))\le 1.$$

P1 and P2 are also well-known to imply that if ⊨ χ → ψ then P (χ) ≤ P (ψ), see [7] (Proposition 2.1.c). Since $\models {{\displaystyle \vee }}_{i=1}^n\theta (t_i)\to {{\displaystyle \vee }}_{i=1}^{n+1}\theta (t_i)$ we obtain $P({{\displaystyle \vee }}_{i=1}^n\theta (t_i))\le P({{\displaystyle \vee }}_{i=1}^{n+1}\theta (t_i))$. $P{({{\displaystyle \vee }}_{i=1}^n{\theta }_i))}_{n\in \mathrm{\mathbb{N}}}$ is a (not necessarily strictly) increasing sequence. Then

$$1=\underset{n\to \mathrm{\infty }}{\lim }P(\underset{i=1}{\overset{n}{{\displaystyle \vee }}}\theta (t_i))=\underset{n\in \mathrm{\mathbb{N}}}{\sup }P(\underset{i=1}{\overset{n}{{\displaystyle \vee }}}\theta (t_i)).$$

(3)

The second equality holds also when $1>{\lim }_{n\to \mathrm{\infty }}P\left({{\displaystyle \vee }}_{i=1}^n\theta \left(t_i\right)\right)$.

If neither ⊨ ∃xθ(x) nor ⊨ ¬∃xθ(x), then {∀x¬θ(x),∃xθ(x)} is a partition. We consider two cases.

In the first case the set $\{\forall x\neg \theta \left(x\right),\theta \left(t_1\right),\theta \left(t_2\right)\wedge \neg \theta \left(t_1\right),\dots ,\theta \left(t_k\right)\wedge \neg {{\displaystyle \vee }}_{j=1}^{k-1}\theta \left(t_j\right),\dots \}$ is not a partition.

For example, this set fails to be a partition for θ(x) = ¬Ut₂ ˄ Ux: the sentence θ(t₂) ˄ ¬θ(t₁) = ¬Ut₂˄Ut₂˄¬(¬Ut₂˄Ut₁) is a contradiction and hence it cannot be contained in a partition π consisting of infinitely many sentences.

$\neg {{\displaystyle \vee }}_{i=1}^m\theta \left(t_i\right)$ cannot be a contradiction since ¬∃θ(x) is satisfiable and $\models \neg \exists \theta \left(x\right)\to \neg {{\displaystyle \vee }}_{i=1}^m\theta (t_i)$. If $\neg {{\displaystyle \vee }}_{i=1}^m\theta \left(t_i\right)$ is a tautology, then all θ_n with n ≤ m are contradictions. Hence, for all m ∈ ℕ the set $\{\neg {{\displaystyle \vee }}_{i=1}^m\theta (t_i)\},\cup \{{\theta }_n:n\le m\mathrm{and}{\theta }_n\text{is satisfiable}\}$ is a partition, as is $\{\neg {{\displaystyle \vee }}_{i=1}^m\theta \left(t_i\right),{{\displaystyle \vee }}_{i=1}^m\theta \left(t_i\right)\}$. Furthermore, {∀x¬θ(x)} ∪ {θ_n : θ_n is satisfiable} is a partition.

Recalling that P(κ) = 0 for all contradictions κ we obtain ${\sum }_{k=1}^{m}P({\theta }_k)=P({{\displaystyle \vee }}_{i=1}^m\theta (t_i))$ and

$$P(\exists x\theta (x))=\underset{m\to \mathrm{\infty }}{\lim }P(\underset{i=1}{\overset{m}{{\displaystyle \vee }}}\theta (t_i)).$$

It remains to show that

$$\underset{m\to \mathrm{\infty }}{\lim }P(\underset{i=1}{\overset{m}{{\displaystyle \vee }}}\theta (t_i))=\underset{m}{\sup }P(\underset{i=1}{\overset{m}{{\displaystyle \vee }}}\theta (t_i)).$$

This follows as we saw above in (3).

In the second case the set {∀x¬θ(x), θ(t₁), θ(t₂) ˄ ¬θ(t₁), …, θ(t_k) ˄ ¬${{\displaystyle \vee }}_{j=1}^{k-1}$ θ(t_j),…} is a partition. Recall that {∀x¬θ(x), ∃xθ(x)} is also a partition. We obtain as in the first case that

$$P(\exists x\theta (x))={\displaystyle \sum _{k=1}^{\mathrm{\infty }}P(\theta (t_k)\wedge \neg \underset{j=1}{\overset{k-1}{{\displaystyle \vee }}}}\theta (t_j))=\underset{m\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{k=1}^{m}P({\theta }_k)=\underset{m}{\sup }}P(\underset{i=1}{\overset{m}{{\displaystyle \vee }}}\theta (t_i)).$$

For the converse, note that P1–3 imply that P is a probability measure on $S\mathrm{ℒ}$, and so additive over countable partitions (§2 in [8]; §2.5 in [6]). Hence $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$. □

Another key feature of probability functions is that they respect logical equivalence:

Definition 2 (Respecting logical equivalence). For a sublanguage${\mathrm{ℒ}}^{\prime }$ of$\mathrm{ℒ}$ we say that a function f : $S\mathrm{ℒ}\to \left[0,1\right]$ respects logical equivalence on ${\mathrm{ℒ}}^{\prime }$, if and only if for all φ, $\psi \in S{\mathrm{ℒ}}^{\prime }$with φ ↔ ψ it holds that f(φ) = f(ψ). For${\mathrm{ℒ}}^{\prime }=\mathrm{ℒ}$ we simply say that f respects logical equivalence.

Proposition 3. The probability functions$P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ respect logical equivalence.

Proof. Suppose $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ and assume that φ, $\psi \in S{\mathrm{ℒ}}^{\prime }$ are logically equivalent. Observe that {φ, ¬φ} and {ψ, ¬φ} are partitions in ${\mathrm{\Pi }}_{\mathrm{ℒ}}$. Hence,

$$P(\phi )+P(\neg \phi )=1=P\left(\psi \right)+P(\neg \phi ).$$

But then P (φ) = P (ψ).

Thus, the $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ assign logically equivalent sentences the same probability. □

If a belief function $B:S\mathrm{ℒ}\to \left[0,1\right]$ respects logical equivalence, it gives sentences which express the same proposition the same degree of belief. Hence, for any n ∈ ℕ, B induces a function °B defined over the propositions F ⊆ Ω_n (c.f., Section 2). °B is defined by:

$$°B(F):=B(\vee F)=B(\underset{\begin{array}{c}\omega \in {\mathrm{\Omega }}_n\\ \omega \in F\end{array}}{{\displaystyle \vee }}\omega ).$$

We will use the notation °ⁿB to avoid ambiguity in cases where n varies.

The notion of a dominated belief function will prove useful in what follows:

Definition 3 (Dominated belief function).$B\in {\mathbb{B}}_{\mathrm{ℒ}}\backslash {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ is dominated by a probability function$P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$, if and only if for all$\phi \in S\mathrm{ℒ}$ it holds that B(φ) ≤ P (φ).

Note that if B is dominated by P, then B ≠ P, and thus B(φ) < P (φ) has to hold at least for one sentence φ.

Proposition 4. There exist$B\in {\mathbb{B}}_{\mathrm{ℒ}}\backslash {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ which are not dominated.

Proof. Let U be a relation symbol in $\mathrm{ℒ}$ of arity a ≥ 1, say. Let Ut₁t be a well-formed formula of ${\mathrm{ℒ}}_2$, i.e., t is a a − 1 tuple with consisting only of t₁ and t₂. Let O₄ := {Ut₁t ˄ Ut₂t, Ut₁t ˄ ¬Ut₂t, ¬Ut₁t ˄ Ut₂t, ¬Ut₁t ˄ ¬Ut₂t}.

Let $B:S\mathrm{ℒ}\to \left[0,1\right]$ be such that

$$B(\phi ):=\{\begin{array}{ll}\frac{1}{100}\hfill & \mathrm{iff}\models \phi \leftrightarrow \omega \text{for some}\omega \in O_4\hfill \\ \frac{50}{100}\hfill & \mathrm{iff}\models \phi \leftrightarrow \omega \vee \nu \text{for different}\omega ,\nu \in O_4\hfill \\ \frac{99}{100}\hfill & \mathrm{iff}\models \phi \leftrightarrow \neg \omega \text{for some}\omega \in O_4\hfill \\ 1\hfill & \mathrm{iff}\phi \text{is a tautolog}y\hfill \\ 0\hfill & \mathrm{otherwise}\hfill \end{array}$$

Clearly, $B\in {\mathbb{B}}_{\mathrm{ℒ}}$. We now that there does not exist a $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ such that B(φ) ≤ P (φ) for all show φ ∈ SL.

Note that

$${\displaystyle \sum _{\omega \in O_4}B(\neg \omega )}=3+\frac{96}{100}$$

and that for all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ it holds that

$${\displaystyle \sum _{\omega \in O_4}P(\neg \omega )}={\displaystyle \sum _{\omega \in O_4}\left(P(\neg \omega )+P(\omega )\right)-}{\displaystyle \sum _{\omega \in O_4}P(\omega )=4-1=3.}$$

(4)

Note for later reference that for all n ≥ 3 and ω ∈ O₄, {¬ω} ∪ {ν ∈ Ω_n : ν⊨ ω} is a partition. So, ${\sum }_{\begin{array}{c}\nu \in {\mathrm{\Omega }}_n\\ \nu \models \omega \end{array}}B(\nu )\le \frac{1}{100}$ has to hold. Hence, ${\sum }_{\nu \in {\mathrm{\Omega }}_n}B(\nu )\le \frac{4}{100}$.

Thus far we have considered partitions of sentences. We shall also need to consider partitions of propositions:

Definition 4 (Partitions of propositions). Let Π_n be the set of partitions on Ω_n. As in Section 2, we take {Ω_n} and {Ω_n, ∅} to be partitions and we suppose that there is no further partition containing ∅.

We then define the set of partitions:$\mathrm{\Pi }:={\displaystyle {\cap }_{n=1}^{\mathrm{\infty }}{\mathrm{\Pi }}_n}$.

We use πⁿ to denote the partition of n-states {{ω} : ω ∈ Ω_n}.

Note that F₁ := {ω ∈ Ω₁ : ω ⊨U₁t₁} and F₂ := {ω ∈ Ω₂ : ω U₁t₁} are different propositions, where U₁ is a unary predicate symbol. F₁ is a member of {F₁, ${\overline{F}}_1$} ∈ Π₁ and F₂ is a member of {F₂, ${\overline{F}}_2$} ∈ Π₂, but not vice versa. So {F₁, ${\overline{F}}_1$} and {F₂, ${\overline{F}}_2$} are different partitions, even if these partitions are intuitively equivalent.

3.3. Application to Inductive Logic

We shall be particularly interested in the use of objective Bayesianism over predicate languages to provide semantics for inductive logic.

Inductive logic typically seeks to answer questions of following form [9] (§1.1):

$${\phi }_1^{X_1},\dots ,{\phi }_k^{X_k}|\approx {\psi }^{?}$$

This asks, if premiss sentences φ₁, …, φ_k of $\mathrm{ℒ}$ have probabilities in sets X₁, …, X_k ⊆ [0, 1] respectively, which probability or set of probabilities should attach to the conclusion sentence ψ?

The answer to this question will depend on the semantics given to the inductive entailment relation |≈ [9] (Part I). One natural option is to give the entailment relation objective Bayesian semantics, denoted by|≈°. Here the premisses are construed as statements about chance, i.e., P^*(φ₁) ∈ X₁, …, P^*(φ_k) ∈ X_k, and the question concerns rational belief: if one’s total evidence is captured by the premisses, to what extent should one believe the conclusion sentence ψ? Applying the norms of objective Bayesianism,

$${\phi }_1^{X_1},\dots ,{\phi }_k^{X_k}|\approx °{\psi }^Y$$

holds just in case P (ψ) ∈ Y for every $P\in {\mathbb{E}}_{\mathrm{ℒ}}$ that has maximal entropy, where

$$\mathbb{E}=\langle {\phi }_1^{X_1},\dots ,{\phi }_k^{X_k}\rangle :=\langle \{P^{*}\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P^{*}({\phi }_1)ϵX_1,\dots ,P^{*}({\phi }_k)ϵX_k\}\rangle .$$

This application of objective Bayesian epistemology to inductive logic is an example in which ${\mathbb{E}}_{\mathrm{ℒ}}$ is generated by constraints involving only sentences of some finite sublanguage ${\mathrm{ℒ}}_n$. We will be particularly interested in the case where φ₁, …, φ_k are quantifier-free sentences, i.e., sentences of ${\mathrm{ℒ}}_n^{\nexists }$ for some n.

Let ${\mathrm{\mathbb{P}}}_{{\mathrm{ℒ}}_n^{\nexists }}$ be the set of probability functions on ${\mathrm{ℒ}}_n^{\nexists }$, and let

$${\mathbb{E}}_n:=\{P_n\in {\mathrm{\mathbb{P}}}_{{\mathrm{ℒ}}_n^{\nexists }}:P_n=P_{\downharpoonright n},P\in {\mathbb{E}}_{\mathrm{ℒ}}\}$$

where P_⇂n is the restriction of P to $S{\mathrm{ℒ}}_n^{\nexists }$. Note that,

$$P_{\downharpoonright n}(\theta ):={\displaystyle \sum _{\begin{array}{c}\omega \in {\mathrm{\Omega }}_n\\ \omega \models \theta \end{array}}P(\omega )}$$

for all $\theta \in S{\mathrm{ℒ}}_n^{\nexists }$.

To ease the reading we also let ${\mathrm{\mathbb{P}}}_n:=\{P_n\in {\mathrm{\mathbb{P}}}_{{\mathrm{ℒ}}_n^{\nexists }}\}$.

Definition 5 (Finitely generated evidence set).${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated if it takes the form${\mathbb{E}}_{\mathrm{ℒ}}=\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P_{\downharpoonright n}\in {\mathbb{E}}_n\}$ for some n ∈ ℕ, where${\mathbb{E}}_n\subseteq {\mathrm{\mathbb{P}}}_{{\mathrm{ℒ}}_n^{\nexists }}$. Thus, ${\mathbb{E}}_{\mathrm{ℒ}}$ is generated by constraints involving only some${\phi }_1,{\phi }_2,\dots ϵS{\mathrm{ℒ}}_n^{\nexists }$ and no other sentences.

From now on, for finitely generated ${\mathbb{E}}_{\mathrm{ℒ}}$, the letter K is used to denote the smallest number n such that ${\mathbb{E}}_{\mathrm{ℒ}}$ is generated by constraints on ${\mathrm{ℒ}}_{{}^n}^{\nexists }$.

Note that an evidence set ${\mathbb{E}}_{\mathrm{ℒ}}$ which is not finitely generated may not be recapturable from $\{{\mathbb{E}}_1,{\mathbb{E}}_2,\dots \}$. For instance, for

$${\mathbb{E}}_{\mathrm{ℒ}}=\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:\underset{n\to \mathrm{\infty }}{\lim }P(\underset{i=1}{\overset{n}{{\displaystyle \wedge }}}U{t}_i)=0\}$$

the following two facts hold simultaneously:

• ${\mathbb{E}}_{\mathrm{ℒ}}\subset {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$
• ${\mathbb{E}}_n\subset {\mathrm{\mathbb{P}}}_n$ for all n ∈ N.

4. Quantifier-Free Languages

We would like to develop an analogue of Theorem 2 for beliefs defined over the sentences of a predicate language: we would like to show that belief functions which minimise worst-case expected loss are probability functions in E that maximise entropy. The main difficulty in moving from the finite domain of propositions to countably many sentences of a predicate language is to ensure that worst-case expected loss is finite where possible, so that these losses can be compared and a belief function can be chosen that minimises worst-case expected loss. For this reason we proceed in two steps. First, in this section, we shall consider the case in which the predicate language has no quantifier symbol, i.e., $\mathrm{ℒ}={\mathrm{ℒ}}^{\nexists }$; comparing worst-case expected loss is more straightforward in this case. Then, in Section 5, we shall examine how far our approach can be extended to handle predicate languages with quantifiers.

First, in Section 4.1 we define the notion of a weighting function. This allows us to define and analyse the concept of entropy of a probability function on $\mathrm{ℒ}={\mathrm{ℒ}}^{\nexists }$ in Section 4.2. In Section 4.3 we introduce the idea of the loss profile of a belief function. Finally in Section 4.4 we show that, in various natural scenarios, the belief function that has the best loss profile is the probability function, from all those calibrated with evidence, that has maximal standard entropy.

4.1. Weighting Functions

Definition 6 (Weighting function). A weighting function on ${\mathrm{ℒ}}_n$, g_n : Π_n → ℝ_≥0, maps partitions π ∈ Π_n to non-negative real numbers. A weighting function on $\mathrm{ℒ}$, $g^{\mathrm{ℒ}}$ : Π → ℝ_≥0, is defined over partitions of propositions of all finite sublanguages. A weighting function on$\mathrm{ℒ}$ can be thought of as a family of weighting functions g_n on${\mathrm{ℒ}}_n$, where n ranges over the natural numbers. Given a fixed weighting function$g^{\mathrm{ℒ}}$ on$\mathrm{ℒ}$, we shall take$g_n^{\mathrm{ℒ}}:=g_{\downharpoonright \mathrm{\Pi }n}$ for each n ∈ ℕ. A (general) weighting function g is taken to be defined over each predicate language$\mathrm{ℒ}={\mathrm{ℒ}}^{\nexists }$. Different languages$\mathrm{ℒ}={\mathrm{ℒ}}^{\nexists }$, ${\mathrm{ℒ}}^{\prime }={{\mathrm{ℒ}}^{\prime }}^{\nexists }$ have different sets of relation symbols.

A weighting function g is atomic if for each $\mathrm{ℒ}$ and each n, g_n depends only on the number of atomic propositions in ${\mathrm{ℒ}}_n$, not on the structure of those atomic propositions. Thus if $\mathrm{ℒ}$ and ${\mathrm{ℒ}}^{\prime }$ are such that ${\mathrm{ℒ}}_n$ and ${{\mathrm{ℒ}}^{\prime }}_m$ have the same number of atomic propositions, then $g_m^{\mathrm{ℒ}}=g_m^{{\mathrm{ℒ}}^{\prime }}$. In this paper we shall suppose that all weighting functions are atomic; hence there will be no need to superscript a weighting function on $\mathrm{ℒ}$ or ${\mathrm{ℒ}}_n$ by the particular language $\mathrm{ℒ}$.

We call g inclusive, if and only if it attaches positive weight to each proposition, i.e., if and only if for all n and all F ⊆ Ω_n it holds that

$${\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ F\in \pi \end{array}}g(\pi )>0}.$$

As in Section 2, g is symmetric if for each n it is invariant under permutations of the states of ${\mathrm{ℒ}}_n$. It is refined if for each n it gives no less weight to a refinement π′ ∈ Π_n of a partition π ∈ Π_n than to π itself. For example, the partition weighting g_Π gives weight 1 to each partition, g_Π(π) = 1 for all π ∈ Π. The proposition weighting$g_{\mathcal{P}}{}_{\mathrm{\Omega }}$ gives weight 1 to each partition of size 2 and weight 0 to all other partitions; this amounts to giving weight 1 to each proposition. The standard weighting g_Ω gives weight 1 to the partition πⁿ of n-states, for each n, and weight 0 to all other partitions. These weighting functions are all symmetric. The partition and proposition weightings are inclusive, but the standard weighting is not. The partition and standard weightings are refined, but the proposition weighting is not.

Definition 7 (Strongly refined weighting function). g is strongly refined if and only if it satisfies the following properties:

• g is refined: in each finite sublanguage, if partition π′ is a refinement of partition π, then g(π′) ≥ g(π).
• Each finite sublanguage receives the same total weight: for all n, ${\sum }_{\pi \in {\mathrm{\Pi }}_n}g\left(\pi \right)$ is constant.
• A state partition on a richer language should not receive less weight than one one a less rich language: if m < n then g(π^m) ≤ g(πⁿ)
• Non-state-partitions receive finite total weight: the following limit exists (i.e., is finite),

$$\underset{k\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{n=1}^k{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}g(\pi )}}.$$

Throughout this paper we will be particularly interested in the following weighting functions:

Definition 8 (Regular weighting function). g is regular if it is atomic, inclusive, symmetric and strongly refined.

4.2. Entropy

Definition 9 (n-entropy). Given a weighting function g and n ∈ ℕ, we define the n-entropy $H_g^n:{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\to \left[0,\mathrm{\infty }\right]$ by:

$$H_g^n(P):=-{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n}g(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)\log °P(F)}.$$

(5)

Recall that, for a probability function P (or indeed any belief function that respects logical equivalence) defined on sentences, °P is the function induced by P over the domain of propositions. Note that by our convention, −0 log 0 = 0 = −1 log 1. Thus, for all n ∈ ℕ,

$$g\left(\{{\mathrm{\Omega }}_n\}\right)P\left({\mathrm{\Omega }}_n\right)\log P\left({\mathrm{\Omega }}_n\right)=0=g\left(\{{\mathrm{\Omega }}_n,\varnothing \})(P(\varnothing )\log P(\varnothing )+P\left({\mathrm{\Omega }}_n\right)\log P\left({\mathrm{\Omega }}_n\right)\right).$$

In calculating n-entropy we may thus ignore all partitions which contain Ω_n.

Definition 10 (Standard entropy). For the standard weighting g_Ω we denote the corresponding n-entropy by$H_{\mathrm{\Omega }}^n$. We refer to$H_{\mathrm{\Omega }}^n$ as standard entropy (on L_n).$H_{\mathrm{\Omega }}^n(P)$ is the well-known Shannon Entropy of the n-states of P :

$$H_{\mathrm{\Omega }}^n(P)=-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_n}P(\omega )\log P(\omega )}.$$

For a fixed weighting function g, we say that $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ has greater entropy than $Q\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$, written P ≫ Q, if the n-entropy of P eventually dominates that of Q, i.e., if there is some N ∈ ℕ such that for all n ≥ N, $H_g^n\left(P\right)>H_g^n\left(Q\right)$.

This relation ≫ for comparing entropy is preferable to an alternative notion posed in terms of the limiting behaviour of the n-entropy of P and Q, which says that P has greater entropy than Q just when ${\lim }_{n\to \mathrm{\infty }}{H}_g^n\left(P\right)>{\lim }_{n\to \mathrm{\infty }}{H}_g^n\left(Q\right)$. This is because the limiting behaviour is not fine-grained enough to distinguish greater from lesser entropy: n-entropy will often tend to infinity for both P and Q, and, even where the limiting n-entropy of P and Q are both finite, these limits may be equal even though the entropy of P is intuitively greater than that of Q, insofar as the n-entropy of P eventually dominates that of Q. See Williamson [1] (§5.5) for further discussion of these comparative notions of entropy.

We will be particularly interested in the probability functions in [ ${\mathbb{E}}_{\mathrm{ℒ}}$] with maximal entropy:

$${\mathrm{maxent}\mathbb{E}}_{\mathrm{ℒ}}:=\{P\in \left[{\mathbb{E}}_{\mathrm{ℒ}}\right]:\text{there is no}Q\in \left[{\mathbb{E}}_{\mathrm{ℒ}}\right]\text{such that}Q\gg P\}.$$

We shall also consider entropy maximisers on finite sublanguages. We shall use the notation:

$${\mathrm{\mathbb{P}}}_n^{†}:=\arg \underset{P\in {\mathbb{E}}_n}{\sup }{H}_g^n\left(P\right).$$

(The members of this set are defined only on the sentences of ${\mathrm{ℒ}}_n$, not on the sentences of the language $\mathrm{ℒ}$ as a whole.) Note that for convex ${\mathbb{E}}_{\mathrm{ℒ}}$, ${\mathbb{E}}_n$ is convex for all n ∈ ℕ and that $H_g^n$ is a strictly concave function on ${\mathbb{E}}_n$ for inclusive g. If g is inclusive, then $H_g^n$ is strictly concave on ${\mathrm{\mathbb{P}}}_n$. Hence ${\mathrm{\mathbb{P}}}_n^{†}$ contains a unique element, which we will denote by ${\mathrm{\mathbb{P}}}_n^{†}$.

Let us consider the set of limit points of the entropy maximisers on finite sublanguages:

Definition 11 (Entropy limit). A probability function is a limit point of the entropy maximisers on finite sublanguages if it is arbitrarily close to infinitely many such maximisers. We denote the set of such limit points by:

$${\mathrm{\mathbb{P}}}^{†}:=\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:\forall ϵ>0,\exists \mathit{infinite}I\subseteq \mathrm{\mathbb{N}},\forall n\in I,\forall \phi \in S{\mathrm{ℒ}}_n,|P(\phi )-P_n{}^{†}(\phi )|<ϵ\}.$$

Whenever ℙ^† consists only of a single function we shall denote that function by ℙ^† and refer to ℙ^† as the entropy limit.

One important desideratum for a procedure for choosing a rational belief function, particularly in the context of inductive logic, is language invariance. We shall consider two notions of language invariance: the following notion defined in terms of finite sublanguages, and a second form of language invariance, introduced in Definition 23, which we term infinite-language invariance.

Definition 12 (Finite-language invariant weighting function). A weighting function g : Π → ℝ_≥0 is finite-language invariant, if and only if the following holds: for all${\mathbb{E}}_{\mathrm{ℒ}}$ finitely generated by constraints on${\mathrm{ℒ}}_K$, if${\mathrm{ℒ}}_n$ and${\mathrm{ℒ}}_m$ are such that${\mathrm{ℒ}}_K\subseteq {\mathrm{ℒ}}_n\subseteq {\mathrm{ℒ}}_m$, then for all$Q\in {\text{arg sup}}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_g^n\left(P\right)$ there exists some$R\in \arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_g^m(P)$ such that Q_⇂n =R_⇂n

4.2.1. The Standard Entropy Limit

Standard entropy, i.e., entropy with respect to the standard weighting g_Ω, is the subject of a substantial literature. We here collect the features of standard entropy most relevant for our purposes.

Firstly, g_Ω is finite-language invariant; see, e.g., [7]. If ${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated and g = g_Ω, then ${\mathrm{\mathbb{P}}}_n^{†}$ contains a unique element. Furthermore, there exists a unique function P ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$] such that for all n ≥ K P_⇂n ∈ ${\mathrm{\mathbb{P}}}_n^{†}$ holds. This function P is the entropy limit with respect to the standard weighting g_Ω; it will be called the standard entropy limit and denoted by $P_{\mathrm{\Omega }}^{†}$. Henceforth we use $P_{\mathrm{\Omega }}^{†}$ to denote the standard entropy limit on $\mathrm{ℒ}$, rather than on Ω as in Section 2.

Definition 13 (Open-minded belief function). We say that a belief function$B\in {\mathbb{B}}_{\mathrm{ℒ}}$ is open-minded on ${\mathrm{ℒ}}^{\prime }\subseteq \mathrm{ℒ}$, if and only if for all$\phi \in S{\mathrm{ℒ}}^{\prime }$ for which there exists some$P\in \left[{\mathbb{E}}_{\mathrm{ℒ}}\right]$ such that P (φ) > 0 it holds that B(φ) > 0. For${\mathrm{ℒ}}^{\prime }=\mathrm{ℒ}$ we say that the belief function$B\in {\mathbb{B}}_{\mathrm{ℒ}}$ is open-minded.

The following proposition lists further important properties of $P_{\mathrm{\Omega }}^{†}$ which we shall make frequent use of in the following two properties—see [7] (p. 95) for a proof of the first property.

Proposition 5.$P_{\mathrm{\Omega }}^{†}$ satisfies the following properties:

• $P_{\mathrm{\Omega }}^{†}$ is open-minded.
• For a finitely generated${\mathbb{E}}_{\mathrm{ℒ}}$, for all n ≥ K and all ν ∈ Ω_n, ω ∈ Ω_K with ν ω it holds that$P_{\mathrm{\Omega }}^{†}\left(\nu \right)=P_{\mathrm{\Omega }}^{†}\left(\omega \right)\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}$.

The second property will follow from Proposition 9 and from the fact that g_Ω is language invariant. Let ν be a consistent conjunction of pairwise different literals such that ν ⊨ ω for some n-state ω with n ≥ K. Denoting by |ν|, |ω| the number of literals in ν, respectively, ω, it follows from the second property in Proposition 5 that $P_{\mathrm{\Omega }}^{†}\left(\nu \right)=P_{\mathrm{\Omega }}^{†}\left(\omega \right)\frac{2^{|\omega |}}{2^{|\nu |}}$.

4.2.2. General Entropies

The question remains as to how the functions on $\mathrm{ℒ}$ with maximal entropy, i.e., the members of maxent ${\mathbb{E}}_{\mathrm{ℒ}}$, relate to the entropy maximisers $P_n^{†}\in {\mathrm{\mathbb{P}}}_n^{†}$ on the finite sublanguages ${\mathrm{ℒ}}_n$. We shall explore this question here.

Proposition 6.${\mathrm{\mathbb{P}}}^{†}\subseteq \left[{\mathbb{E}}_{\mathrm{ℒ}}\right]$.

Proof. Let P ^† ∈ ℙ^†. Thus, for all sentences $\phi \in S\mathrm{ℒ}$, P^†(φ) is the limit of a sequence ${\left(P_n^{†}\right)}_n{}_{\in I}$ such that $P_n^{{}^{†}}\in \left[{\mathbb{E}}_n\right]$ and I ⊆ ℕ is infinite. Since [ ${\mathbb{E}}_{\mathrm{ℒ}}$] and all the [ ${\mathbb{E}}_n$] are closed, P ^† ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$].

Of particular interest is the most equivocal probability function of ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$, which is called the equivocator and denoted by P=. P= is uniquely defined by the requirement that for all n ∈ ℕ it assigns all n-states ω ∈ Ω_n the same probability, $P_{=}\left(\omega \right)=\frac{1}{|\mathrm{\Omega }|}$ The restriction of P= to ℙ_n is denoted by P_{= ⇂n}.

In certain cases ℙ^† will only contain a single limit point ℙ^†.

Definition 14. [4] (Definition 16, p. 3573.) A weighting function g_n on${\mathrm{ℒ}}_n$ is called equivocator-preserving, if and only if

$${\mathrm{\mathbb{P}}}_n^{†}=\{Q_{\downharpoonright n}:Q\in \arg \underset{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}}{\sup }{H}_g^n(P)\}=\{P_{=\downharpoonright n}\}.$$

g is called equivocator-preserving, if and only if g_n is equivocator-preserving for all n ∈ ℕ.

Proposition 7. If P= ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$] and if g is symmetric and inclusive, then ℙ^† = {P=}.

Proof. By Landes and Williamson [4] (Corollary 6, p. 3574) we have

$$\arg \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{H}_g^n(P)=\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P_{\downharpoonright n}=P_{=\downharpoonright n}\}.$$

It follows that

$$\underset{n\to \mathrm{\infty }}{\lim }\arg \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{H}_g^n(P)=\{P_{=}\}$$

and hence ℙ^† = {P=}. □

So, if g is symmetric and inclusive, then g is equivocator-preserving. In Appendix B we shall show that there exist non-symmetric g which are equivocator-preserving.

Definition 15 (State-inclusive weighting function). Given$\mathrm{ℒ}$, we call a weighting function g : Π → [0, 1] state-inclusive on ${\mathrm{ℒ}}_n$, if and only if for each state ω ∈ Ω_n there exists a π ∈ Π_n such that {ω} ∈ π and g(π) > 0. A weighting function g : Π → [0, 1] is state-inclusive, if and only if it is state-inclusive on each${\mathrm{ℒ}}_n$. It is eventually state-inclusive, if and only if there exists a J ∈ ℕ such that for all n ≥ J, g is state-inclusive on${\mathrm{ℒ}}_n$.

For example, if g(πⁿ) > 0 for all n ∈ ℕ, then g is state-inclusive. Moreover, inclusive implies state-inclusive.

Lemma 1. If g is state-inclusive on${\mathrm{ℒ}}_n$, then$H_g^n$ is strictly concave on ℙ_n.

Proof. Let P, Q ∈ ℙ_n be different and λ ∈ (0, 1). Since for all π ∈ Π_n we have ${\sum }_{F\in \pi }°P(F)=1={\sum }_{F\in \pi }°Q(F)$ we find using the strict concavity of −x · log x on [0, 1]

$$\begin{array}{l}{H}_g^n(\lambda P+(1-\lambda )Q)={\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n}-g(\pi ){\displaystyle \sum _{F\in \pi }\left(\lambda °P(F)+(1-\lambda )°Q(F)\right)\cdot \log (\lambda °P(F)+(1-\lambda )°Q(F))}}\\ \ge {\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n}-g(\pi ){\displaystyle \sum _{F\in \pi }\left(\lambda °P(F)\log (\lambda °P(F))\right)+\left((1-\lambda )°Q(F)\log ((1-\lambda )°Q(F))\right)}}\\ =H_g^n(\lambda P)+H_g^n((1-\lambda )Q).\end{array}$$

The inequality is strict, if and only if there exists some π ∈ Π_n with g(π) > 0 such that there is some F ∈ π with °P (F ) ≠ °Q(F). Since P, Q are different probability functions, there exists some ω ∈ Ω_n such that P (ω) ≠ Q(ω). Since g is state-inclusive, g(π) > 0 for some π ∈ Π_n with {ω} ∈ π. Hence, the inequality is strict. □

Proposition 8. If${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated, and g is eventually state-inclusive and language invariant, then ℙ^† consists of a single probability function ℙ^† and for all$\phi \in S\mathrm{ℒ}$ it holds that${\lim }_{n\to \mathrm{\infty }}{P}_n^{†}(\phi )=P^{†}(\phi )$.

Proof. Recall that ${\mathbb{E}}_{\mathrm{ℒ}}$ is expressible by constraints in ${\mathrm{ℒ}}_K$ and let J as in Definition 15. Let n ≥ max{J, K}.

By the above Lemma 1, $H_g^n$ is strictly concave on ℙ_n. Since ${\mathbb{E}}_n$ is convex, $\arg {\sup }_{P\in E_n}{H}_g^n\left(P\right)$ contains a single element. Hence, Q, R ∈ $\arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_g^n\left(P\right)$ agree on $S{\mathrm{ℒ}}_n$.

Since g is language invariant, we have $\arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_g^m\left(P\right)$$\subseteq \arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_g^l\left(P\right)$ for all n ≤ l ≤ m.

For all $\phi \in S\mathrm{ℒ}$, there exists an s ∈ ℕ such that $\phi \in S{\mathrm{ℒ}}_s$. Hence, for l, m ≥ max{J, K,s} it holds that for $R\arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_g^m\left(P\right)$ and $Q\in \arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_g^l\left(P\right)$ that R(φ) = Q(φ). □

For instance, standard entropy [4] (Equation 80), the substate weighting and other examples generated by Landes and Williamson [4] (Lemma 8) are eventually state-inclusive and language invariant. Note that these weighting functions are not inclusive.

Definition 16. We say that H_g is strictly concave, if and only if for all n ∈ ℕ, $H_g^n$ is strictly concave on ℙ_n.

Proposition 9 (Equivocation beyond${\mathrm{ℒ}}_n$). Let${\mathbb{E}}_{\mathrm{ℒ}}$ be finitely generated and let g be symmetric. If H_g is strictly concave, then for all n ≥ K and all ν, μ ∈ Ω_n such that there exists an ω ∈ Ω_K with ν ⊨ ω and μ ⊨ ω it holds that

$$P_n^{†}\left(\nu \right)=P_n^{†}(\mu )=P_n^{†}\left(\omega \right)·\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}$$

for all$P_n^{†}\in {\mathrm{\mathbb{P}}}_n^{†}$.

We call such ν, μ ∈ Ω_n extensions of ω ∈ Ω_K and say that $P_n^{†}$ equivocates beyond${\mathrm{ℒ}}_K$. In particular, $P_n^{†}$ equivocates beyond ${\mathrm{ℒ}}_K$up to ${\mathrm{ℒ}}_n$.

Proof. Let n > K and let P ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$] be such that there exist ν, μ ∈ Ω_n with P (ν) ≠ P(μ) such that there exists an ω ∈ Ω_K with ν ⊨ ω and μ ⊨ ω. Assume for contradiction that $P\in \arg {\sup }_{R\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_g^n\left(R\right)$.

Now define a probability function $Q\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ by first specifying Q on the n-states. Let

$$\begin{array}{l}Q\left(\nu \right):=P(\mu )\\ Q(\mu ):=P\left(\nu \right)\\ Q\left(\eta \right):=P\left(\eta \right)\text{for all}\eta \in {\mathrm{\Omega }}_n\backslash \{\nu ,\mu \}.\end{array}$$

For a λ ∈ Ω_r with r ≥ n we let $Q\left(\lambda \right):=Q\left(\xi \right)\frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_r|}$ where ξ ∈ Ω_r is the unique r-state such that λ ⊨ ξ.

By construction, Q and P agree on $S{\mathrm{ℒ}}_K$. Since ${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated, it follows that Q ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$]. Furthermore, Q_⇂n can be obtained from P_⇂n by a renaming of n-states and it holds that Q_⇂n ≠ P_⇂n. Since g_n is symmetric it holds that $H_g^n\left(P\right)=H_g^n\left(Q\right)$. Since [ ${\mathbb{E}}_{\mathrm{ℒ}}$] is convex and $H_g^n$ is strictly concave, neither P_⇂n nor Q_⇂n can maximise $H_g^n$ over [ ${\mathbb{E}}_n$].

This contradicts P maximising $H_g^n$ over [ ${\mathbb{E}}_n$].

Corollary 1. Let${\mathbb{E}}_{\mathrm{ℒ}}$ be finitely generated. If$H_g^n$ is strictly concave on ℙ_n for n ≥ K and if g is symmetric, then for n ≥ K the following maximisation problem

$$\begin{array}{cc}maximise:& H_g^n(P)\\ subjectto:& P\in \left[{\mathbb{E}}_{\mathrm{ℒ}}\right]\end{array}$$

can be understood as an optimisation problem in the variables P (ω) with ω ∈ Ω_K. In particular, the number of variables does not grow as n tends to infinity.

Proof. Follows immediately from the above proposition by noting that $P_n^{†}\in \arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_g^n\left(P\right)$ equivocates beyond ${\mathrm{ℒ}}_K$ up to ${\mathrm{ℒ}}_n$.

This corollary shows that in order to compute $P_n^{†}$ for n ≥ K one needs to solve an optimisation problem on Ω_K. If g is not language invariant, then, in general, the objective function of the optimisation problem changes as n changes. So, in general, ( $P_n^{†}$)_⇂K varies with n.

Corollary 2. Under the assumptions of Proposition 9 it holds that for F ⊆ Ω_n and ν, μ ∈ Ω_n, °$P_n^{†}$(F) =°$P_n^{†}$_(Fν,μ), where F_ν,μ is the result we obtain by replacing ν by μ and vice versa in F.

Proof. For an η ∈ Ω_n denote by ω_η ∈ Ω_K the unique K-state such that η ⊨ ω_η. Now simply note that by Proposition 9

$$°P_n^{†}(F)={\displaystyle \sum _{\begin{array}{c}\eta \in {\mathrm{\Omega }}_n\\ \eta \in F\end{array}}{P}_n^{†}(\eta )={\displaystyle \sum _{\begin{array}{c}\eta \in {\mathrm{\Omega }}_n\\ \eta \in F\end{array}}{P}_n^{†}({\omega }_{\eta })\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}}={\displaystyle \sum _{\begin{array}{c}\eta \in {\mathrm{\Omega }}_n\\ \eta \in F_{\nu ,\mu }\end{array}}{P}_n^{†}({\omega }_{\eta })\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}=°P_n^{†}(F_{\nu ,\mu })}.}$$

Corollary 3. Let${\mathbb{E}}_{\mathrm{ℒ}}$ be finitely generated. For all n ≥ K and all$P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ equivocating beyond${\mathrm{ℒ}}_K$ up to${\mathrm{ℒ}}_n$ it holds for all K ≤ k ≤ n − 1 that

$$H_{\mathrm{\Omega }}^{k+1}(P)=H_{\mathrm{\Omega }}^k(P)-\log \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_{k+1}|}.$$

If g is symmetric and H_g is strictly concave, then

$$H_{\mathrm{\Omega }}^K(P_k^{†})-H_{\mathrm{\Omega }}^K(P_{\mathrm{\Omega }}^{†})=H_{\mathrm{\Omega }}^{k+1}(P_{k+1}^{†})-H_{\mathrm{\Omega }}^{k+1}(P_{\mathrm{\Omega }}^{†}).$$

Proof. For ν ∈ Ω_k+1 let ω_ν ∈ Ω_k be the unique k state such that ν ⊨ ω_ν. For K ≤ k ≤ n − 1 we now find for a $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ equivocating beyond ${\mathrm{ℒ}}_K$ up to ${\mathrm{ℒ}}_n$

$$\begin{array}{l}{H}_{\mathrm{\Omega }}^{k+1}(P)=-{\displaystyle \sum _{\nu \in {\mathrm{\Omega }}_{k+1}}P(\nu )\log P(\nu )}\\ =-{\displaystyle \sum _{\nu \in {\mathrm{\Omega }}_{k+1}}P(\nu )\log }\left(P({\omega }_{\nu })\cdot \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_{k+1}|}\right)\\ =-\log \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_{k+1}|}-{\displaystyle \sum _{\nu \in {\mathrm{\Omega }}_{k+1}}P(\nu )\log P({\omega }_{\nu })}\\ =-\log \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_{k+1}|}-{\displaystyle \sum _{\nu \in {\mathrm{\Omega }}_{k+1}}{\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_{k+1}\\ \nu \models \omega \end{array}}P(\nu )\log P({\omega }_{\nu })}}\\ =-\log \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_{k+1}|}-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_k}\log P(\omega )\cdot \left({\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_{k+1}\\ \nu \models \omega \end{array}}P(\nu )}\right)}\\ =-\log \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_{k+1}|}-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_k}P(\omega )\log P(\omega )\cdot }\\ =-\log \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_{k+1}|}+H_{\mathrm{\Omega }}^k(P).\end{array}$$

The second part of the proof follows directly by observing that $P_{\mathrm{\Omega }}^{†}$ and $P_n^{†}$ equivocate beyond ${\mathrm{ℒ}}_K$ up to ${\mathrm{ℒ}}_n$ by Proposition 9. □

Corollary 4. Let${\mathbb{E}}_{\mathrm{ℒ}}$ be finitely generated. For all n ≥ K and all$P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ not equivocating beyond${\mathrm{ℒ}}_K$ up to${\mathrm{ℒ}}_n$ it holds that$H_{\mathrm{\Omega }}^n(P)<H_{\mathrm{\Omega }}^K(P)-\log \frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}$.

Proof. There has to exist at least one ξ ∈ Ω_K such that there exist ν, λ ∈ Ω_n with ν ⊨ ξ and λ ⊨ ξ such that P (ν) ≠ P (λ). Since P is a probability function it holds that $P\left(\xi \right)={\sum }_{\begin{array}{c}\nu \in {\mathrm{\Omega }}_n\\ \nu \models \xi \end{array}}P\left(\nu \right)$. We thus find sing the log-sum inequality (see, e.g., Theorem 2.7.1 in [10])

$$\begin{array}{l}-P(\xi )\log (\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|})-P(\xi )\log P(\xi )=-P(\xi )\log (\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}P(\xi ))\\ =-{\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_n\\ \nu \models \xi \end{array}}(\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}P(\xi ))\log (\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}P(\xi ))}\\ >-{\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_n\\ \nu \models \xi \end{array}}P(\nu )\log P(\nu )}.\end{array}$$

If ξ ∈ Ω_K is such that for all ν, λ ∈ Ω_n with ν⊨ ξ and λ⊨ ξ it holds that P (ν) = P (λ), then the above calculation holds with the exception that the inequality is in fact an equality.

We hence find by summing over all ω ∈ Ω_K

$$\begin{array}{l}{H}_{\mathrm{\Omega }}^K(P)-\log (\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|})={\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_K}-P(\omega )}\left(\log (\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|})+\log P(\omega )\right)\\ >-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_K}{\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_n\\ \nu \models \xi \end{array}}-P(\nu )\log P(\nu )}}\\ ={\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_n\\ \nu \models \xi \end{array}}-P(\nu )\log P(\nu )}.\\ =H_{\mathrm{\Omega }}^n(P).\end{array}$$

Corollary 5. Let E_L be finitely generated. If g is symmetric and if for all n ≥ K$H_g^n$ is strictly concave on ℙ_n, then

$${\mathrm{\mathbb{P}}}^{†}\ne \varnothing .$$

Proof. By Corollary 1, $P_n^{†}\in \left[{\mathbb{E}}_n\right]$ is uniquely determined by $P_n^{†}\left(\omega \right)$ for ω ∈ Ω_K. That is, we can understand ${\left(P_n^{†}\right)}_{n\in \mathrm{\mathbb{N}}}$ as sequence taking values in ${\left[0,1\right]}^{|}{}^{{\mathrm{\Omega }}_K|}\subset {\mathrm{ℝ}}^{|}{}^{{\mathrm{\Omega }}_K|}$ and ${\left[0,1\right]}^{|}{}^{{\mathrm{\Omega }}_K|}$ is compact. Hence, the sequence ${\left({\left(P_n^{†}\right)}_{\downharpoonright K}\right)}_{n\in \mathrm{\mathbb{N}}}$ has point of accumulation, Q, with Q ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$]. Let I ⊆ ℕ be infinite such that ${\lim }_i{}_{\in I,i\to \mathrm{\infty }}{P}_{n_i}^{†}\left(\omega \right)=Q\left(\omega \right)$ for all ω ∈ Ω_K.

Recall that for n > K that $P_n^{†}$ equivocates under ${\mathrm{ℒ}}_K$ up to ${\mathrm{ℒ}}_n$. We now extend Q to a probability function in [ ${\mathbb{E}}_{\mathrm{ℒ}}$] by defining it on the n-states ν ∈ Ω_n for n > K as follows: $Q\left(\nu \right):=\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}\cdot Q({\omega }_{\nu })=\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}\cdot {\lim }_{i\in I,i\to \mathrm{\infty }}{P}_{n_i}^{†}({\omega }_{\nu })$. Hence, Q equivocates beyond ${\mathrm{ℒ}}_K$.

Consider some $\phi \in S\mathrm{ℒ}$. It follows that there is some r ≥ K such that $\phi \in S{\mathrm{ℒ}}_r$. For ν ∈ Ω_r denote by ω_ν the unique element of Ω_K such that ν ⊨ ω_ν.

We thus find

$$\begin{array}{l}\underset{\begin{array}{c}i\to \mathrm{\infty }\\ i\in I\end{array}}{\lim }{P}_{n_i}^{†}(\phi )=\underset{\begin{array}{c}i\to \mathrm{\infty }\\ i\in I\end{array}}{\lim }{\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_r\\ \nu \models \phi \end{array}}{P}_{n_i}^{†}}(\nu )\\ ={\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_r\\ \nu \models \phi \end{array}}\underset{\begin{array}{c}i\to \mathrm{\infty }\\ i\in I\end{array}}{\lim }{P}_{n_i}^{†}}(\nu )\\ ={\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_r\\ \nu \models \phi \end{array}}\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}\cdot \underset{\begin{array}{c}i\to \mathrm{\infty }\\ i\in I\end{array}}{\lim }{P}_{n_i}^{†}}({\omega }_{\nu })\\ ={\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_r\\ \nu \models \phi \end{array}}\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}\cdot Q}({\omega }_{\nu })\\ ={\displaystyle \sum _{\begin{array}{c}\nu \in {\mathrm{\Omega }}_r\\ \nu \models \phi \end{array}}Q}(\nu )\\ =Q(\phi ).\end{array}$$

We now turn our attention to the calibrated functions with maximal entropy, maxent ${\mathbb{E}}_{\mathrm{ℒ}}$. Our aim is to show that maxent ${\mathbb{E}}_{\mathrm{ℒ}}={\mathrm{\mathbb{P}}}^{†}=\{P_{\mathrm{\Omega }}^{†}\}$ holds for regular g.

Lemma 2. If g is regular, then

$$\underset{n\to \mathrm{\infty }}{\lim }\log \left(|{\mathrm{\Omega }}_n|\right)\cdot {\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}g(\pi )=0.}$$

Proof. Since g is total it is in particular g defined for the language ${\mathrm{ℒ}}^U$ which only contains a single relation symbol which is unary. When needed, we shall add a superscript ^U express that we consider ${\mathrm{ℒ}}^U$.

Now define a sequence (a_n)_n∈ℕ by

$$a_n:={\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n^U\backslash \{{\pi }^n\}}g(\pi )}.$$

By the Cauchy condensation test [11] (p. 61, Theorem 3.27) for (not necessarily strictly) decreasing sequences we have that

$${\displaystyle \sum _{n=1}^{\mathrm{\infty }}{a}_n<\mathrm{\infty }\iff }{\displaystyle \sum _{k=0}^{\mathrm{\infty }}{2}^k{a}_{2^k}<\mathrm{\infty }.}$$

(6)

Since the series on the left converges by the assumption on finite weights, so does the right, and that implies that ${\lim }_{k\to \mathrm{\infty }}{2}^k{a}_{2^k}=0$.

For n ∈ ℕ let k ∈ ℕ be such that 2^k ≤ n < 2^k+1. Since a_n is (not necessarily strictly) decreasing $a_n\le a_{2^k}$. Hence,

$$0\le n{a}_n\le 2^{k+1}{a}_n\le 2^{k+1}{a}_{2^k}=2(2^k{a}_{2^k}).$$

The right hand side converges to 0 by Cauchy’s condensation test (6). Thus,

$$\begin{array}{l}0=\underset{n\to \mathrm{\infty }}{\lim }n\cdot a_n\\ =\underset{n\to \mathrm{\infty }}{\lim }n\cdot {\log }_2(2)\cdot a_n\\ =\underset{n\to \mathrm{\infty }}{\lim }n\cdot {\log }_2(2)\cdot a_n\\ =\underset{n\to \mathrm{\infty }}{\lim }{\log }_2(|{\mathrm{\Omega }}_n^U|)\cdot a_n\\ =\underset{n\to \mathrm{\infty }}{\lim }\log (|{\mathrm{\Omega }}_n^U|)\cdot a_n\\ =\underset{n\to \mathrm{\infty }}{\lim }\log (|{\mathrm{\Omega }}_n^U|)\cdot {\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n^U\backslash \{{\pi }^n\}}g(\pi )}\end{array}$$

Now if $\mathrm{ℒ}$ is some other language in our sense different from ${\mathrm{ℒ}}^U$, then for all n ∈ ℕ there exists an m_n > n such that $|{\mathrm{\Omega }}_n|=|{\mathrm{\Omega }}_n^U|$. This in turn implies the existence of a canonical bijections f_n identifying Π_n with ${\mathrm{\Pi }}_{m_n}^U$ which respect the structure of partitions.

Because g is atomic it follows that for all π ∈ Π_n that g(π) = g(f_n(π)) holds. Thus,

$$a_n={\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}g(\pi )=}{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_{m_n}^U\backslash \{{\pi }^{m_n}\}}g(\pi )}.$$

We then observe that the sequence ${(\log (|{\mathrm{\Omega }}_n^U|)\cdot {\sum }_{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}g(\pi ))}_{n\in \mathrm{\mathbb{N}}}$ is a subsequence of ${(\log (|{\mathrm{\Omega }}_n^U|)\cdot {\sum }_{\pi \in {\mathrm{\Pi }}_n^U\backslash \{{\pi }^n\}}g(\pi ))}_{n\in \mathrm{\mathbb{N}}}$ Hence,

$$\begin{array}{l}0=\underset{n\to \mathrm{\infty }}{\lim }\log (|{\mathrm{\Omega }}_{m_n}^U|)\cdot {\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_{m_n}^U\backslash \{{\pi }^{m_n}\}}g(\pi )}\\ =\underset{n\to \mathrm{\infty }}{\lim }\log (|{\mathrm{\Omega }}_n|)\cdot {\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}g(\pi )}.\end{array}$$

Lemma 3. If g is strongly refined and state-inclusive, then there exist 0 < a ≤ b < +∞ such that for all n ∈ ℕ, g(πⁿ) ∈ [a, b].

Proof. For every ω ∈ Ω₁ there exists some π ∈ Π₁ which contains {ω} with g(π) > 0. π¹ refines all these partitions (or π¹ is that partition). Hence, g(π¹) > 0.

Since state partitions on richer languages are assigned more weight it follows that g(πⁿ) ≥ g(π¹) > 0 for all n ∈ ℕ.

Trivially, $g\left({\pi }^n\right)\le {\sum }_{\pi \in {\mathrm{\Pi }}_n}g\left(\pi \right)$. The latter is constant for all n. Hence, the sequence g(πⁿ) is bounded from above by ${\sum }_{\pi \in {\mathrm{\Pi }}_n}g(\pi )$.

We can thus choose a, b as follows a := g(π¹) and $b:={\sum }_{\pi \in {\mathrm{\Pi }}_1}g(\pi )$.

Following [4] (p. 3556) we define:

Definition 17 (Spectrum of π). The spectrum of a partition π is defined as the multi-set of sizes of the members of π. We write σ(π) to denote the spectrum of π.

In other words, if π′ can be obtained from π by permuting the states in the members of π, then σ(π) = σ(π′). If g is symmetric, then g(π) only depends on the spectrum of π.

Lemma 4. If g is symmetric, then for all n and all spectra s

$$P_{=}\in \arg \underset{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}}{\sup }{\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-g(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)}\log °P(F).$$

Proof. First note that ${\sum }_{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-g\left(\pi \right){\sum }_{F\in \pi }°P\left(F\right)\log P°\left(F\right)$ is a concave function, since −x log x is concave function for x ∈ [0, 1].

If P, P′ ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ are such that one can be obtained from the other by a permutation of n-states, then for all spectra s

$${\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-g(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)\log °P(F)={\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-g(\pi ){\displaystyle \sum _{F\in \pi }°P^{\prime }(F)°\log P^{\prime }(F)}.}}$$

Hence, for all fixed spectra s P_{= ⇂n} lies inside the contour lines of the function ${\sum }_{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-g\left(\pi \right){\sum }_{F\in \pi }°P\left(F\right)\log P°\left(F\right)$ in ℙ_n. It follows that

$$P_{=}\in \arg \underset{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}}{\sup }{\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-g(\pi ){\displaystyle \sum _{F\in \pi }°P(F)\log °P(F)}.}$$

Corollary 6. If g is symmetric and such that

$$\underset{n\to \mathrm{\infty }}{\lim }\log |{\mathrm{\Omega }}_n|{\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \pi \ne {\pi }^n\end{array}}g(\pi )=}0,$$

then for all P ∈ P_L

$$\underset{n\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \pi \ne {\pi }^n\end{array}}-g(\pi ){\displaystyle \sum _{F\in \pi }°P(F)\log °P(F)}=}0.$$

Proof. For a fixed spectrum s we have

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-g(\pi ){\displaystyle \sum _{F\in \pi }°P(F)\log °P(F)}={\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-g(\pi ){\displaystyle \sum _{F\in \pi }°P_{=}(F)\log °P_{=}(F)}}}\\ ={\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-g(\pi ){\displaystyle \sum _{F\in \pi }\frac{|F|}{|{\mathrm{\Omega }}_n|}\cdot \log \frac{|F|}{|{\mathrm{\Omega }}_n|}}}\\ ={\displaystyle \sum _{\begin{array}{c}\pi \in {\mathrm{\Pi }}_n\\ \sigma (\pi )=s\end{array}}-\frac{g(\pi )}{|{\mathrm{\Omega }}_n|}{\displaystyle \sum _{F\in \pi }|F|\cdot (\log |F|-\log |{\mathrm{\Omega }}_n|).}}\end{array}$$

Thus,

$$\begin{array}{l}|\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{\displaystyle \sum _{{}_{\sigma (\pi )=s}^{\pi \in {\mathrm{\Pi }}_n}}-g(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)\log °P(F)|}\le {\displaystyle \sum _{{}_{\sigma (\pi )=s}^{\pi \in {\mathrm{\Pi }}_n}}\frac{g(\pi )}{|{\mathrm{\Omega }}_n|}}{\displaystyle \sum _{F\in \pi }|F|\cdot \log |{\mathrm{\Omega }}_n|}\\ ={\displaystyle \sum _{{}_{\sigma (\pi )=s}^{\pi \in {\mathrm{\Pi }}_n}}g(\pi )\cdot \log |{\mathrm{\Omega }}_n|.}\end{array}$$

Summing over all spectra now yields for all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$

$${\displaystyle \sum _{{}_{\pi \ne {\pi }^n}^{\pi \in {\mathrm{\Pi }}_n}}-g(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)\log °P(F)}\le \log |{\mathrm{\Omega }}_n|{\displaystyle \sum _{{}_{\pi \ne {\pi }^n}^{\pi \in {\mathrm{\Pi }}_n}}g(\pi ).}$$

The claimed result follows.

In particular, if g is regular then the above Corollary applies, by Lemma 2.

Let us consider the application of objective Bayesianism to inductive logic (Section 3.3). It turns out that if g is regular and ${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated then the functions in $[{\mathbb{E}}_{\mathrm{ℒ}}]$ with maximal entropy coincide with the entropy limits (Definition 11), and moreover there is a unique such function, the standard entropy limit:

Theorem 3. Let g be symmetric, atomic, state-inclusive and strongly refined, and${\mathbb{E}}_{\mathrm{ℒ}}$ be finitely generated. Then

$${\mathrm{maxent}\mathbb{E}}_{\mathrm{ℒ}}={\mathcal{P}}^{†}=\{P_{\mathrm{\Omega }}{}^{†}\}.$$

(7)

Note that if g is also inclusive, then g is regular.

Proof. By Lemma 3 there exist 0 < a ≤ b < +∞ such that g(πⁿ) ∈ [a, b] for all n ∈ N and by Corollary 6 the combined weight given to all other partitions on Π_n tends to zero, as n increases, fast enough that, for all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$,

$$\underset{n\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{{}_{\pi \ne {\pi }^n}^{\pi \in {\mathrm{\Pi }}_n}}-g(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)\log °P(F)}=0.$$

For $Q\in [{\mathbb{E}}_{\mathrm{ℒ}}]\backslash \{P_{\mathrm{\Omega }}^{†}\}$there exists a minimal $n\in \mathrm{\mathbb{N}}$with n ≥ K such that ${\left(P_{\mathrm{\Omega }}^{†}\right)}_{\downharpoonright n}\ne Q_{\downharpoonright n}$. Since $H_{\mathrm{\Omega }}^n$ is strictly convex on ${\mathbb{E}}_n$ and $P_{\mathrm{\Omega }}^{†}$ maximises $H_{\mathrm{\Omega }}^n$ over $[{\mathbb{E}}_n]$ it holds that $H_{\mathrm{\Omega }}^n\left(P_{\mathrm{\Omega }}^{†}\right)>H_{\mathrm{\Omega }}^n(Q)$. Using Corollary 3 and Corollary 4 we obtain $H_{\mathrm{\Omega }}^r\left(P_{\mathrm{\Omega }}^{†}\right)-H_{\mathrm{\Omega }}^r(Q)\ge H_{\mathrm{\Omega }}^k\left(P_{\mathrm{\Omega }}^{†}\right)-H_{\mathrm{\Omega }}^k(Q)$ for r ≥ n. Thus,

$$\begin{array}{l}{H}_{\mathrm{\Omega }}^r\left(P_{\mathrm{\Omega }}^{†}\right)-H_{\mathrm{\Omega }}^r(Q)=-g({\pi }^r)H_{\mathrm{\Omega }}^k\left(P_{\mathrm{\Omega }}^{†}\right)+{\displaystyle \sum _{{}_{\pi \ne {\pi }^n}^{\pi \in {\mathrm{\Pi }}_n}}-g(\pi )}{\displaystyle \sum _{F\in \pi }°P_{\mathrm{\Omega }}^{†}(F)\log °P_{\mathrm{\Omega }}^{†}(F)}\\ +g({\pi }^r)H_{\mathrm{\Omega }}^k\left(Q\right)+{\displaystyle \sum _{{}_{\pi \ne {\pi }^n}^{\pi \in {\mathrm{\Pi }}_n}}-g(\pi )}{\displaystyle \sum _{F\in \pi }°Q(F)\log °Q(F)}\\ \ge -g({\pi }^r)\left(H_{\mathrm{\Omega }}^r\left(P_{\mathrm{\Omega }}^{†}\right)-H_{\mathrm{\Omega }}^r(Q)\right)\\ +{\displaystyle \sum _{{}_{\pi \ne {\pi }^n}^{\pi \in {\mathrm{\Pi }}_n}}-g(\pi )}{\displaystyle \sum _{F\in \pi }°P_{\mathrm{\Omega }}^{†}(F)\log °P_{\mathrm{\Omega }}^{†}(F)}+{\displaystyle \sum _{{}_{\pi \ne {\pi }^n}^{\pi \in {\mathrm{\Pi }}_n}}g(\pi )}{\displaystyle \sum _{F\in \pi }°Q(F)\log °Q(F)}.\end{array}$$

For large enough r the sums over the π ≠ π^r become negligible. Since g(π^r) is bounded there has to exist some R ∈ ℕ with R ≥ max{K, n} such that for all r ≥ R it holds that

$$g({\pi }^r)\left(H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})-H_{\mathrm{\Omega }}^n(Q)\right)>{\displaystyle \sum _{\underset{\pi \ne {\pi }^r}{\pi \in {\mathrm{\Pi }}_r}}-g(\pi )}{\displaystyle \sum _{F\in \pi }°}{P}_{\mathrm{\Omega }}^{†}(F)\log °P_{\mathrm{\Omega }}^{†}(F)+°Q(F)\log °Q(F).$$

Hence, for all large enough r it holds that $H_g^r(P_{\mathrm{\Omega }}^{†})-H_g^r(Q)>0$.

Thus, maxent $E_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}^{†}\}$.

For the second part of the proof we show that for all r ∈ N and all F ⊆ Ω_r it holds that

$$\underset{n\to \mathrm{\infty }}{\lim }°P_n^{†}(F)-°P_{\mathrm{\Omega }}^{†}(F)=0.$$

(8)

Observe that for all n ∈ ℕ

$$\begin{array}{r}|H_{\mathrm{\Omega }}^n(P_n^{†})-H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})|=|H_{\mathrm{\Omega }}^n(P_n^{†})-\frac{1}{n({\pi }^n)}{H}_g^n(P_n^{†})+\frac{1}{n({\pi }^n)}{H}_g^n(P_n^{†})-H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})|\\ \le {\displaystyle \sum _{\underset{\pi \ne {\pi }^n}{\pi \in {\mathrm{\Pi }}_n}}-\frac{g(\pi )}{g({\pi }^n)}}{\displaystyle \sum _{F\in \pi }°}{P}_n^{†}(F)\log °P_n^{†}(F)+|\frac{1}{g({\pi }^n)}{H}_g^n(P_n^{†})-H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})|.\end{array}$$

The first sum tends to zero as n goes to infinity by our assumptions on g.

For the second sum observe that for all ϵ > 0 there exists an N ∈ ℕ such that for all n ≥ max{N, K} and all P ∈ [ $E_{\mathrm{ℒ}}$] it holds that $|\frac{1}{g({\pi }^n)}{H}_g^n(P)-H_{\mathrm{\Omega }}^n(P)|$< ϵ. Hence, ϵ > $|{\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}\frac{1}{g({\pi }^n)}{H}_g^n(P)-{\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{H}_{\mathrm{\Omega }}^n(P)|=|\frac{1}{g({\pi }^n)}{H}_g^n(P_n^{†})-H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})|$. So,

$$\underset{n\to \mathrm{\infty }}{\lim }{H}_{\mathrm{\Omega }}^n(P_n^{†})-H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})=0.$$

For all n ≥ K, $P_n^{†}$ and $P_{\mathrm{\Omega }}^{†}$ equivocate under $ℒ$_K up to $ℒ$_n (Proposition 9). Hence, it holds that $H_{\mathrm{\Omega }}^n(P_n^{†})-H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})=H_{\mathrm{\Omega }}^K(P_n^{†})-H_{\mathrm{\Omega }}^K(P_{\mathrm{\Omega }}^{†})$ (Corollary 3). So,

$$\underset{n\to \mathrm{\infty }}{\lim }{H}_{\mathrm{\Omega }}^K(P_n^{†})-H_{\mathrm{\Omega }}^K(P_{\mathrm{\Omega }}^{†})=\underset{n\to \mathrm{\infty }}{\lim }{H}_{\mathrm{\Omega }}^n(P_n^{†})-H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})=0.$$

$H_{\mathrm{\Omega }}^K$is a strictly concave and continuous function on ℙ_K. Hence, lim_n→∞$P_n^{†}$(ω) = $P_{\mathrm{\Omega }}^{†}$(ω) for all ω ∈ Ω_K. So, lim_n→( $P_n^{†}$)_⇂K = ( $P_{\mathrm{\Omega }}^{†}$)_⇂K.

For an arbitrary n ≥ K and an F ⊆ Ω_n we find using that $P_{\mathrm{\Omega }}^{†}$ equivocates beyond $ℒ$_K

$$\begin{array}{l}\underset{n\to \mathrm{\infty }}{\lim }°P_k^{†}(F)=\underset{n\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\underset{v\in F}{v\in {\mathrm{\Omega }}_n}}{P}_k^{†}(v)=\underset{n\to \mathrm{\infty }}{\lim }}{\displaystyle \sum _{\underset{v\in F}{v\in {\mathrm{\Omega }}_n}}\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}\cdot }{P}_k^{†}({\omega }_v)\\ ={\displaystyle \sum _{\underset{v\in F}{v\in {\mathrm{\Omega }}_n}}\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}\cdot \underset{n\to \mathrm{\infty }}{\lim }}{P}_k^{†}({\omega }_v)\\ ={\displaystyle \sum _{\underset{v\in F}{v\in {\mathrm{\Omega }}_n}}\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}\cdot }{P}_{\mathrm{\Omega }}^{†}({\omega }_v)\\ ={\displaystyle \sum _{\underset{v\in F}{v\in {\mathrm{\Omega }}_n}}{P}_{\mathrm{\Omega }}^{†}({\omega }_v)}\\ =°P_{\mathrm{\Omega }}^{†}(F).\end{array}$$

The result for F ⊆ Ω_r with r < K follows similarly. □

4.3. Loss and Expected Loss

We shall now analyse the notion of the loss incurred by an agent with belief function B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$. In Section Section 5 we shall be interested how degrees of beliefs in quantified sentences affect losses. The following definition, axioms L1–4, Theorem 4 and Proposition 12 apply within our current, quantifier-free framework, i.e., $ℒ$ = $ℒ$^∄but they also apply to quantified sentences, i.e., $ℒ$ = $ℒ$^∃.

Definition 18 (Independent Sublanguages). Let B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ be a fixed belief function such that B(τ) = 1 for any tautology τ, and $ℒ$ = $ℒ$₁ ∪ $ℒ$₂ where $ℒ$₁ and $ℒ$₂ are disjoint: $ℒ$₁ and $ℒ$₂ contain the same constants, they do not have a relation symbol in common and the union of the relation symbols in $ℒ$₁ and $ℒ$₂ equals {U₁,…, U_s}, the set of relation symbols in $ℒ$. We say that $ℒ$₁ and $ℒ$₂ are independent sublanguages, written $ℒ$₁⫫_B$ℒ$₂, if and only if B(ϕ₁ ˄ ϕ₂) = B(ϕ₁) · B(ϕ₂) for all ϕ₁ ∈ S$ℒ$₁ and ϕ₂ ∈ S$ℒ$₂. Let B_⇂$ℒ$1(ϕ₁) := B(ϕ₁), B_⇂$ℒ$2 (ϕ₂) := B(ϕ₂).

By analogy with the line of argument of Section 2, we shall suppose that a default loss function L : S$ℒ$ ×${\mathbb{B}}_{\mathrm{ℒ}}$→ (− ∞, ∞] satisfies the following requirements. Here L(φ, B) is to be interpreted as the loss specific to φ turning out to be true, when one adopts belief function B:

• L1. L(φ, B) = 0, if B(φ) = 1.
• L2. L(φ, B) strictly increases as B(φ) decreases from 1 towards 0.
• L3. L(φ, B) only depends on B(φ).
• L4. Losses are additive when the language is composed of independent sublanguages: if $ℒ$ = $ℒ$₁ ∪ $ℒ$₂ for $ℒ$₁⫫_B$ℒ$₂, then L(ϕ₁ ˄ ϕ₂, B) = L₁(ϕ₁, B_⇂$ℒ$1) + L₂(ϕ₂, B_⇂$ℒ$2), where L₁, L₂ are loss functions defined on $ℒ$₁, $ℒ$₂ respectively.

Theorem 4. If a loss function L on S$ℒ$ ×${\mathbb{B}}_{\mathrm{ℒ}}$ satisfies L1–4, then L(φ, B) = −k log B(φ), where the constant k > 0 does not depend on the language $ℒ$.

Proof. The proof is exactly analogous to that of Landes and Williamson [4] (Theorem 4), which gives the result in the case in which $ℒ$ is a finite propositional language. □

Since multiplication by a constant is equivalent to change of base, we can take log to be the natural logarithm. Since we will be interested in the belief functions that minimise loss, rather than in the absolute value of any particular losses, we can take k = 1 without loss of generality. Theorem 4 thus allows us to focus on the logarithmic loss function:

$$L^{\log }(\phi ,B):=-\log B(\phi ).$$

Next we define our notion of expected loss. The expectation is taken with respect to a probability function P, and we consider the expectation taken over each partition of propositions. Each partition is weighted by the given weighting function g. Attention is restricted to inclusive weighting functions, so that each belief is evaluated; if the weighting function were not inclusive then degrees of belief in some propositions would fail to contribute to the expectation.

Definition 19 (n-representation). A sentence θ ∈ S$ℒ$_n n-represents a proposition F ⊆ Ω_n, if and only if F = {ω ∈ Ω_n: ω ⊨ θ}. Let $ℱ$ ⊆ $\mathcal{P}$Ω_n be a set of pairwise distinct propositions. We say that Θ ⊆ S$ℒ$_n is a set of n-representatives of $ℱ$, if and only if each sentence θ ∈ Θ n-represents a unique proposition in $ℱ$ and each proposition in $ℱ$ is n-represented by a unique sentence θ ∈ Θ.

A set ρ of n-representatives of$\mathcal{P}$Ω_n will be called an n-representation. We shall use ρF to denote the sentence in ρ which n-represents F. We denote by ϱ_n the set of all n-representations.

Note that if belief function B respects logical equivalence, then for all n ∈ ℕ, all F ⊆ Ω_n and all l-representations ρ with l ≥ n it holds that B(ρF ) = °B(F ). Otherwise there exist an n ∈ ℕ a proposition F ⊆ Ω_n and n-representations ρ, ρ′, such that B(ρF) ≠ B(ρ′F).

Definition 20 (n-score). Given a loss function L, an inclusive weighting function g: Π → ℝ_≥0, n ∈ ℕ, and an n-representation ρ ∈ ϱ_n we define the representation-relative n-score $S_{g,\rho }^{L,n}$: ℙ_$ℒ$ ×${\mathbb{B}}_{\mathrm{ℒ}}$ → [−∞, ∞] by:

$$S_{g,\rho }^{L,n}(P,B):={\displaystyle \sum _{\pi \in {\prod }_n}g(\pi )}{\displaystyle \sum _{F\in \pi }P(\rho F)L(\rho F,B).}$$

Define the (representation-independent) n-score $S_g^{L,n}:{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\times {\mathbb{B}}_{\mathrm{ℒ}}\to [-\mathrm{\infty },\mathrm{\infty }]$ by

$$S_g^{L,n}(P,B):=\underset{\rho \in {\varrho }_n}{\sup }{S}_{g,\rho }^{L,n}(P,B).$$

(As a technical convenience, we shall consider loss functions and n-scores to be defined more generally, taking arguments P, B: S$ℒ$ → [0, 1], although we will primarily be concerned with the case above where P is a probability function and B is a belief function.)

In the light of Theorem 4, we will focus exclusively on the logarithmic loss function in this paper:

$$\begin{array}{c}{S}_{g,\rho }^{L,n}(P,B):={\displaystyle \sum _{\pi \in {\prod }_n}g(\pi )}{\displaystyle \sum _{F\in \pi }P(\rho F)\log B(\rho F),}\\ S_g^n(P,B):=\underset{\rho \in {\varrho }_n}{\sup }{S}_{g,\rho }^n(P,B).\end{array}$$

For P ∈ ℙ_$ℒ$ we have that P (ρF) = P (ρ′F ) for all ρ, ρ′ ∈ ϱ_n, since P respects logical equivalence. Hence for P, Q ∈ ℙ_$ℒ$ we have

$$\begin{array}{l}{S}_g^n(P,Q)=\underset{\rho \in {\varrho }_n}{\sup }{S}_{g,\rho }^n(P,Q)\\ =-{\displaystyle \sum _{\pi \in {\prod }_n}g(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)\log °Q(F)}\\ =S_g(°P,°Q),\end{array}$$

where S_g is the propositional scoring rule introduced in Section 2, in the case Ω = Ω_n. There are also connections with g-entropy $H_g^n$, defined in (5), and the propositional notion of entropy H_g, defined in Section 2:

$$S_g^n(P,P)=H_g^n(P)=H_g(°P).$$

If g = g_Ω, we call the resulting function the standard logarithmic n-score:

$$\begin{array}{l}{S}_{\mathrm{\Omega }}^n(P,B)=\underset{\rho \in {\varrho }_n}{\sup }-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_n}P(\rho \{\omega \})\log B(\rho \{\omega \})}\\ =-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_n}P(\omega )}P\{\omega \}\log B(\omega ),\end{array}$$

where the latter equality applies if B respects logical equivalence.

The question arises as to how $S_g^n$, the notion of expected loss defined on a finite sublanguage _$ℒ$n, relates to loss on $ℒ$, the language as a whole. One particularly natural suggestion is that B has a better overall loss profile than B′ if the latter’s n-scores eventually dominate those of B or if the worst-case n-score incurred by B′ is eventually greater than that of B:

• If B has lower worst-case expected loss than B′ for all sufficiently large n, then B has a better loss profile than B′.
• If for all P ∈ ℙ_$ℒ$, B has an expected loss which is less than or equal than that of B′, and if for some P ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$], B has strictly lower expected loss than B′ for sufficiently large n, then B has a better loss profile than B′.

We make this precise as follows:

Definition 21 (Better loss profile). B has a better loss profile than B′ if and only if:

• There exists some N ∈ ℕ such that for all n ≥ N, ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n$ (P, B) < ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n$ (P, B′), or
• $S_g^n$ (P, B) ≤ $S_g^n$ (P, B′) < +∞ for all P ∈ ℙ_$ℒ$ and all n ∈ ℕ, and there exist at least one function Q ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$] and some N_Q ∈ ℕ such that$S_g^n$ (Q, B) < $S_g^n$ (Q, B′) for all n ≥ N_Q.

We write B ≺ B′ to denote that B has better loss profile than B′. We will be interested in those belief functions that have the best loss profile, i.e., the minimal elements of ≺, and define:

$${\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}:=\{B\in {\mathbb{B}}_{\mathrm{ℒ}}:thereisno{B}^{\prime }\in {\mathbb{B}}_{\mathrm{ℒ}}suchthat{B}^{\prime }\prec B\}.$$

(9)

Proposition 10 (Properties of ≺). The binary relation ≺ is asymmetric, partial, irreflexive and transitive.

Proof. Note that if for all P ∈ ℙ_$ℒ$ and all n ∈ ℕ it holds that $S_g^n$ (P, B) ≤ $S_g^n$ (P, B′), then ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n$ (P, B) ≤ ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n$ (P, B′) follows trivially. Hence, conditions 1 and 2 of Definition 21 are consistent, in the sense that the induced relation ≺ is asymmetric.

There exist different B, B′ ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ which are not open-minded on $ℒ$₁ and thus have infinite loss on $ℒ$_n for all n ≥ 1 (cf., Proposition 13). For example, if B(τ′) = B′(τ′) = 0 where τ′ is a tautology in S$ℒ$₁, then B and B′ have infinite expected loss for all n ∈ ℕ and all P ∈ ℙ_$ℒ$. Thus, ≺ is only partial.

That ≺ is irreflexive follows directly from the definition.

Now consider B₁, B₂, B₃ ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ such that B₁ ≺ B₂ ≺ B₃. We will consider cases to prove that B₁ ≺ B₃.

If there exist N_1,2, N_2,3 such that

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B_1)<\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B_2)\mathrm{for}\mathrm{all}n\ge N_{1,2}\\ \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B_2)<\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B_3)\mathrm{for}\mathrm{all}n\ge N_{2,3,}\end{array}$$

then

$$\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B_1)<\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B_3)\mathrm{for}\mathrm{all}n\ge \max \{N_{1,2},N_{2,3}\}.$$

Thus, B₁ ≺ B₃.

Now assume that there exists a number N_1,2 such that ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n$ (P, B₁) < ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n$ (P, B₂) for all n ≥ N_1,2 and assume that the pair (B₂, B₃) satisfies the second condition of Definition 21. Then, ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n$ (P, B₁) < ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n$ (P, B₃) for all n ≥ N_1,2. Thus, B₁ ≺ B₃.

The same argument shows that if the pair (B₁, B₂) satisfies the second condition of Definition 21 and the pair (B₂, B₃) satisfies the first condition, then B₁ ≺ B₃.

Finally, suppose that the pairs (B₁, B₂) and (B₂, B₃) both satisfy the second condition of Definition 21. Then for all P ∈ ℙ_$ℒ$ and all n ∈ ℕ it holds that $S_g^n$ (P, B₁) ≤ $S_g^n$ (P, B₃). Furthermore, there has to exist a Q ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$] and an N_Q ∈ ℕ such that for all n ≥ N_Q it holds that $S_g^n$ (Q, B₁) < $S_g^n$ (Q, B₂). But then $S_g^n$ (Q, B₁) < $S_g^n$ (Q, B₃) for all n ≥ N_Q. Thus, B₁ ≺ B₃.

Since ≺ is irreflexive and transitive it cannot contain a cycle.

One main theme of the rest of this paper will be the search for belief functions with the best loss profile. Since the loss function L we are interested in is − log B(φ), and these values monotonically decrease as B(φ) increases from 0 to 1, it follows that, ceteris paribus, the belief functions with better loss profiles assign greater degrees of belief to sentences.

It might appear then that the normalisation (see Definition 1) would directly imply that no B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$\ℙ_$ℒ$ could have the best loss profile. Intuitively, this might be thought to hold since the belief functions B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$\ℙ_$ℒ$ assign smaller degrees of belief than the probability functions P ∈ ℙ_$ℒ$. However, Equation (4) shows that some B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$\ℙ_$ℒ$ assign greater degrees of belief than a probability function P ∈ ℙ_$ℒ$ to certain sentences in the following sense: there exists a set of sentences Φ ⊂ S$ℒ$ such that for all P ∈ ℙ_$ℒ$ it holds that ∑_φ∈Φ B(φ)> ∑_φ∈Φ P(φ).

While Condition 1 of Definition 21 deals with worst-case expected loss, Condition 2 deals with dominance of expected loss. Now, dominance is often used on its own to justify the Probability norm; see, e.g., de Finetti [12] (Chapter 3) and more recently by Joyce [13,14]. So, one might think that Condition 2 is strong enough on its own to imply the probability norm. However this is not the case:

Proposition 11. For${\mathbb{E}}_{\mathrm{ℒ}}$ = ℙ_$ℒ$ there exist a weighting function g and a non-probabilistic belief function B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$\ℙ_$ℒ$ such that no probability function P ∈ ℙ_$ℒ$ has a loss which dominates that of B in the sense of Condition 2.

Proof. It suffices to show that there exist a weighting g and a B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$\ℙ_$ℒ$ such that for all Q ∈ ℙ_$ℒ$ there exist a P ∈ ℙ_$ℒ$ and infinitely many n ∈ ℕ such that $S_g^n$ (P, B) < $S_g^n$ (P, Q).

Consider a B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$\ℙ_$ℒ$ from Proposition 4 and consider an arbitrary Q ∈ ℙ_$ℒ$. Then there has to exist an ν ∈ O₄ such that Q(ν) ≠ B(ν). Next note that Q(¬ν) ≠ B(¬ν) follows. Then, − $\frac{1}{100}$ log $\frac{1}{100}-\frac{99}{100}$log $\frac{99}{100}<-\frac{1}{100}$ log Q(ν) − $\frac{99}{100}$ log Q(ν) since the logarithmic scoring rule is strictly proper.

So, for P ∈ ℙ_$ℒ$ with P (ν) = $\frac{1}{100}$ and g({ν, ¬ν}) > 0 it holds that

$$\begin{array}{l}g(\{v,\neg v\})\left(-P(v)\log (B(v))-P(\neg v)\log (B(\neg v))\right)\\ <g(\{v,\neg v\})\left(-P(v)\log (Q(v))-P(\neg v)\log (Q(\neg v))\right).\end{array}$$

Next let ν₁ := ¬Ut₁t ˄ ¬Ut₂t, ν₂ := Ut₁t ˄ ¬Ut₂t, ν₃ := ¬Ut₁t ˄ Ut₂t, and ν₄ := Ut₁t ˄ Ut₂t. For n ≥ 4 let $F_n^i$ ⊂ Ω_n be the unique proposition which is equivalent to ν_i, $F_n^i$ = {ω ∈ Ω_n : ω ⊨ ν_i}.

Now define g_n for n ≥ 4 as follows:

$$\begin{array}{c}{g}_n(\{F_n^i,{\overline{F}}_n^i\}):=1,\mathrm{if}n\equiv i\mathrm{mod}4\\ g_n(\pi ):=0,\mathrm{else}.\end{array}$$

So, for this B and this g we have found that for all Q ∈ ℙ_$ℒ$ there exist a P ∈ ℙ_$ℒ$ and infinitely many n ∈ ℕ (every fourth n) such that

$$\begin{array}{l}{S}_g^n(P,B)=-\frac{1}{100}\log \frac{1}{100}-\frac{99}{100}\log \frac{99}{100}\\ <-\frac{1}{100}\log \log Q(v)-\frac{99}{100}\log Q(v)\\ =S_g^n(P,Q).\end{array}$$

□

In general, determining the functions comprising minloss ${\mathbb{B}}_{\mathrm{ℒ}}$ is a challenging problem, which we shall tackle in due course. However, there is one general property we can prove directly: assigning zero degree of belief to an epistemically possible sentence is irrational, in the sense that it exposes one to avoidable losses. To see this, first note that:

Proposition 12. For any${\mathbb{E}}_{\mathrm{ℒ}}$, there exists a probability function P ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ which is open-minded.

Proof. The set of consistent sentences in $ℒ$ is countable. The set

$$\varphi :=\{\phi \in S\mathrm{ℒ}:\mathrm{there}\mathrm{exists}\mathrm{a}P\in {\mathbb{E}}_{\mathrm{ℒ}}\mathrm{with}P(\psi )>0\}$$

is a subset of the set of consistent sentences and is thus countable, too. We can hence enumerate Φ by some countable index set, I, say. Note that |I| ≥ 2 since P (τ) = 1 for all P ∈ ℙ_$ℒ$ and all tautologies τ.

For all φ ∈ Φ choose some P_φ ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ such that P_φ(φ) > 0. Next, for all i ∈ I pick an α_i ∈ (0, 1) ⊂ ℝ such that ∑_i∈I α_i = 1. Since |I| ≥ 2 such α_i exist.

We shall now define an open-minded function P ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ by putting

$$P={\displaystyle \sum _{i\in I}{\alpha }_i{P}_{{\phi }_i}.}$$

Note that P is in ${\mathbb{E}}_{\mathrm{ℒ}}$ since it is a convex combination of probability functions in the convex set ${\mathbb{E}}_{\mathrm{ℒ}}$.

We next show that P is indeed open-minded. Let φ ∈ Φ be at the j-th position in the enumeration I of Φ. We now obtain P (φ) ≥ α_jP_φ(φ) > 0. So, P (φ) > 0 for all φ ∈ Φ. □

Proposition 13. B ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$ implies that B is open-minded.

Proof. If B is not open-minded, then there exists a k ∈ ℕ and a φ ∈ S$ℒ$_k such that B(φ) = 0 and there exists a P ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$] such that P (φ) > 0. Since φ ∈ S$ℒ$_r for all r ≥ k, it holds for all r ≥ k that ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^r$(P,B)=+∞.

By Proposition 12 there exists an open-minded Q ∈ [ ${\mathbb{E}}_{\mathrm{ℒ}}$]. Thus, ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^r$ (P, Q) < ∞ for all r. □

Note that the above proposition does not imply that minloss ${\mathbb{B}}_{\mathrm{ℒ}}$ is non-empty.

4.4. Minimax Theorems

In this section we shall relate the belief functions that have best loss profile to the probability functions that have maximal g-entropy.

It turns out that an improvement in loss profile is not necessarily accompanied by an increase in entropy (Appendix A). Nevertheless, we shall see that given appropriate conditions on g, there is a close relationship between the belief function that has the best loss profile and the probability function which has maximum entropy. On a finite sublanguage, the unique belief function with minimum worst-case expected loss is the probability function with maximum entropy (Section 4.4.1). Moreover, on the language $ℒ$ as whole, if the evidence set ${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated then the unique belief function with the best lost profile (i.e., the belief function that is minimal with respect to ≺) is the probability function in E_L with maximal entropy (Section 4.4.2). However, this is not necessarily so when ${\mathbb{E}}_{\mathrm{ℒ}}$ is not finitely generated (Section 6.1).

4.4.1. Minimax on Finite Sublanguages

Lemma 5. For all n ∈ ℕ, all P ∈ ℙ_$ℒ$ and all B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ respecting logical equivalence on $ℒ$_n it holds that$S_g^n$ (P, B) = $S_{g,\rho }^n$ (P, B) for all ρ ∈ ϱ_n.

Proof. Simply note that $S_{g,\rho }^n$ (P, B) = −$-{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n}g(\pi ){\displaystyle \sum _{F\in \pi }°P(F)}}$log B(ρF) does not depend on ρ ∈ ϱ_n. □

Lemma 6. For all inclusive g, for all n ∈ ℕ and each belief function

$$B^{†}\in \arg \underset{B\in {\mathbb{B}}_{\mathrm{ℒ}}}{\inf }\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }\underset{\rho \in {\varrho }_{{}_n}}{\sup }{S}_{g,\rho }^n(P,B),$$

B^† respects logical equivalence on $ℒ$_n. Furthermore, for all such B^† there exists a partition π ∈ Π_n such that ∑_F∈π B^†(ρF)=1 for all ρ ∈ϱ_n.

Proof. Firstly, B^† cannot assign all φ ∈ S$ℒ$_n degree of belief 0, since this would an incur an infinite worst-case expected loss; and as we saw in Proposition 13, there are functions which have finite worst-case expected loss.

Assume for contradiction that a B^† ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ does not respect logical equivalence on $ℒ$_n. Then define a function B^inf : S$ℒ$ → [0, 1] which respects logical equivalence on $ℒ$_n by

$$B^{\inf }(\phi ):=\{\begin{array}{ll}{\inf }_{\underset{\models \phi \leftrightarrow \psi }{\psi \in S{\mathrm{ℒ}}_n}}{B}^{†}(\psi ),& \mathrm{if}\phi \in S{\mathrm{ℒ}}_n\\ B(\phi )& \mathrm{otherwise}.\end{array}$$

The next step in this proof is to show that

$$\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{g}}^n(P,B^{\inf })=\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{g}}^n(P,B^{†}).$$

In the second part of the proof we shall see that there is a belief function which has a strictly better worst case expected loss than B^inf. This then contradicts the assumption that the belief function B^† has best worst case expected loss, i.e., B^† ∈ arg ${\inf }_{B\in {\mathbb{B}}_{\mathrm{ℒ}}}$${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$${\sup }_{\rho \in {\varrho }_n}$$S_{\mathrm{g},\rho }^n\left(P,B\right)$.

Since B^† does not respect logical equivalence on ${\mathrm{ℒ}}_n$, there are logical equivalent φ, ψ ∈ $S{\mathrm{ℒ}}_n$ such that B^†(φ) ≠ B^†(ψ). Thus, B^inf(φ) < max{B^†(φ), B^†(ψ)} and hence B^inf(φ) + B^inf(¬φ) < max{B^†(φ), B^†(ψ)} + B^†(¬φ) ≤ 1. The last inequality holds since B^† ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$. So, $B^{\inf }{}_{\downharpoonright n}\notin {\mathrm{\mathbb{P}}}_n$.

Recall that we extended the definition of scoring rules allowing the belief function to be any function defined on $S\mathrm{ℒ}$ taking values in [0, 1]. We shall be careful not to appeal to results that assume a normalised belief function in this situation.

We now find for P ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$

$$\begin{array}{l}{S}_{\mathrm{g}}^n(P,B^{†})=\underset{\rho \in {\varrho }_n}{\sup }{S}_{\mathrm{g},{\rho }_n}^n(P,B^{†})\\ =\underset{\rho \in {\varrho }_n}{\sup }-{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n}\mathrm{g}(\pi )}{\displaystyle \sum _{F\in \pi }P(\rho F)\log B^{†}(\rho F)}\\ =-{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n}\mathrm{g}(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)\underset{\rho \in {\varrho }_n}{\inf }}\log B^{†}(\rho F)\\ =-{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n}\mathrm{g}(\pi ){\displaystyle \sum _{F\in \pi }P(\rho F)\log B^{\inf }(\rho F)\mathrm{for}\mathrm{all}\rho \in {\varrho }_n}}\\ =S_{\mathrm{g},\rho }^n(P,B^{\inf })forall\rho \in {\varrho }_n\\ =\underset{\rho \in {\varrho }_n}{\sup }{S}_{\mathrm{g},\rho }^n(P,B^{\inf })\\ =S_{\mathrm{g}}^n(P,B^{\inf }).\end{array}$$

Hence ${\sup }_{p\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_{\mathrm{g}}^n(P,B^{†})={\sup }_{p\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_{\mathrm{g}}^n(P,B^{\inf })$, as claimed above.

Let us now consider cases to derive a contradiciton.

Case i There exists a π ∈ ${\prod }_n$ such that ∑_F∈π B^inf(ρF)=1.

Since B^inf respects logical equivalence this fact is independent of the particular ρ ∈ ϱ_n. Recall that we use the notation °B^inf = °ⁿB^inf to denote the function that B^inf induces over propositions in Ω_n, defined by °B^inf(F) = B^inf(∨F).

With this convention we then note that °B^inf ∈ $\mathbb{B}$ \$\mathrm{\mathbb{P}}$. Let $\mathbb{E}$ be the set of probability functions on Ω_n which are in the canonical one-to-one correspondence with the probability functions on ${\mathbb{E}}_n$, i.e., $\mathbb{E}:=\{°P:P\in {\mathbb{E}}_{\mathrm{ℒ}}\}$. We thus find, using Theorem 2 to obtain the strict inequality, that:

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{g}}^n(P,B^{†})=\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{g}}^n(P,B^{\inf })\\ =\underset{P\in \mathbb{E}}{\sup }{S}_{\mathrm{g}}(°P,°B^{\inf })\\ =\underset{P\in \mathbb{E}}{\sup }-{\displaystyle \sum _{\pi \in {\prod }_n}\mathrm{g}(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)\log °B^{\inf }(F)}\\ >\underset{P\in \mathbb{E}}{\sup }-{\displaystyle \sum _{\pi \in {\prod }_n}\mathrm{g}(\pi )}{\displaystyle \sum _{F\in \pi }°P(F)\log °P_n^{†}(F)}\\ =\underset{P\in \mathbb{E}}{\sup }{S}_{\mathrm{g}}(°P,°P_n^{†})\\ =\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{g}}^n(P,P_n^{†}).\end{array}$$

Case ii For all π ∈ Π_n and all ρ ∈ ϱ_n it holds that ∑_F∈π B^inf(ρF) < 1.

Since B^inf respects logical equivalence on ${\mathrm{ℒ}}_n$ we may consider the induced function °B^inf defined over propositions of Ω_n. Since Π_n is finite, so is the set {∑_F∈π °B^inf(F)}. Thus, sup_π∈Πn ∑_F∈π °B^inf (F) = 1 − ϵ for some ϵ ∈ (0, 1].

Let us now define a function $B^{\prime }:S\mathrm{ℒ}\to [0,1]$. Denote by μ ∈ (0, 1] the unique number such that for all π ∈ Π_n and all ρ ∈ ϱ_n it holds that ∑_F∈π μ+B^inf (ρF) = ∑_F∈π μ + °B^inf(F) ≤ 1 and for at least one π ∈ Π_n and one ρ ∈ ϱ_n we have ∑_F∈π μ + B^inf (ρF) = ∑_F∈π μ + °B^inf(F) = 1

Put B′(φ) := μ + B^inf(φ) > B^inf(φ) for all φ ∈ $S{\mathrm{ℒ}}_n$ and B′(φ) := 0 otherwise. Observe that B′ ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ and that B′(¬τ) ≥ μ > 0 for the tautologies τ of ${\mathrm{ℒ}}_n$. But then °B′ ∈ $\mathbb{B}\backslash \mathrm{\mathbb{P}}$. Then for all π ∈ Π_n and all P ∈ $[{\mathbb{E}}_n]$ we have −∑ _F∈π P (ρF) log B′ (ρF) < −∑ _F∈π P(ρF) log B^inf (ρF). We now apply Theorem 2 to find the strict inequality below

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{g}}^n(P,B^{†})=\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{g}}^n(P,B^{\inf })\\ \ge \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{g}}^n(P,B^{\prime })\\ =\underset{P\in \mathbb{E}}{\sup }{S}_{\mathrm{g}}(°P,°B^{\prime })\\ >S_g(°P,°P_n^{†})\\ =\underset{P\in \mathbb{E}}{\sup }{S}_{\mathrm{g}}(°P,°P_n^{†})\\ =\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{g}}^n(P,P_n^{†}).\end{array}$$

So, in Case i and in Case ii we have found that $P_n^{†}$ has strictly better worst-case expected loss than B^† contradicting B^† ∈ arg ${\inf }_{B\in {\mathbb{B}}_{\mathrm{ℒ}}}$${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$${\sup }_{\rho \in {\varrho }_n}$$S_{\mathrm{g},\rho }^n(P,B)$.

Finally, we need to show that for all such belief functions B^† there exists a π ∈ Π_n such that ∑_F∈π °B^†(F) = 1. Suppose for contradiction that is not the case. Note that B^† respects logical equivalence on ${\mathrm{ℒ}}_n$. Hence, we can define a belief function B′ ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ by adding a strictly positive number μ as in Case ii. B′ has a worst-case expected loss that is less or equal to the worst-case expected loss of B^†. Again, we find that °B′ ∈ $\mathbb{B}\backslash \mathrm{\mathbb{P}}$ and hence B′ does not have minimal worst-case expected loss. Clearly then, B^† cannot have minimal worst-case expected loss. Contradiction. □

Theorem 5 (Finite sublanguage minimax). For all inclusive$\mathrm{g}$, all n ∈ $\mathrm{\mathbb{N}}$, all C ∈ arg ${\inf }_{B\in {\mathbb{B}}_{\mathrm{ℒ}}}$${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$S_{\mathrm{g}}^n(P,B)$ and all Q ∈ arg ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$H_{\mathrm{g}}^n(P)$ it holds that

$$C_{\downharpoonright n}=Q_{\downharpoonright n}=P_n^{†}.$$

Proof. From Lemma 6 we know that for every C ∈ arg ${\inf }_{B\in {\mathbb{B}}_{\mathrm{ℒ}}}$${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$S_g^n(P,B)$ it holds that C_⇂n respects logical equivalence on ${\mathrm{ℒ}}_n$ and that °C := °ⁿC ∈ $\mathbb{B}$ (since C is normalised). Every probability function in P ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ respects logical equivalence (Proposition 3).

Thus, $S_{\mathrm{g}}^n(P,C)$ and $S_{\mathrm{g}}^n(P,P)$ collapse to $S_{\mathrm{g}}(°P,°C)$, respectively $S_{\mathrm{g}}(°P,°P)$, the logarithmic scoring rule for propositions (1).

However, for the propositional case we know from Theorem 2 that the unique $\mathrm{g}$-entropy maximiser on $\mathrm{\mathbb{P}}$ is the unique worst-case expected loss minimiser on $\mathbb{B}$, $P_{\mathrm{g}}^{†}=°P_n^{†}$. arg ${\inf }_{B\in \mathbb{B}}$${\sup }_{P\in \mathbb{E}}$$S_{\mathrm{g}}(P,B)=\arg {\sup }_{P\in \mathbb{E}}$$H_{\mathrm{g}}(P)=\{P_{\mathrm{g}}^{†}\}$.

Thus, for all F ⊆ Ω_n it holds that $C(\rho F)=P_{\mathrm{g}}^{†}(F)$ for all ρ ∈ ϱ_n. Hence, $C_{\downharpoonright n}=Q_{\downharpoonright n}=P_n^{†}$. □

4.4.2. Minimax for Inductive Logic

We shall now consider the language $\mathrm{ℒ}$ as a whole. We shall assume in this section that E_L is finitely generated by constraints on ${\mathrm{ℒ}}_K$. As noted in Section 3.3, this is the scenario that is of key relevance to inductive logic. Our goal is to justify the norms of objective Bayesianism by showing that the belief functions with the best loss profile are the probability functions in ${\mathbb{E}}_{\mathrm{ℒ}}$ with maximum entropy.

First we shall see that this is the case if $\mathrm{g}$ is language invariant:

Proposition 14 (Language invariance minimax). If$\mathrm{g}$ is inclusive and language invariant and if${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated, then

$$\min \mathrm{loss}{\mathbb{B}}_{\mathrm{ℒ}}=\max \mathrm{ent}{\mathbb{E}}_{\mathrm{ℒ}}={\mathrm{\mathbb{P}}}^{†}=\{P^{†}\}.$$

Proof. Note that we have ${\mathrm{\mathbb{P}}}^{†}=\{P^{†}\}$ from Proposition 8, in particular $P_n^{†}=P_{\downharpoonright n}^{†}$ for all n ≥ K.

Since $\mathrm{g}$ is inclusive, $H_{\mathrm{g}}^n$ is strictly concave on ${\mathrm{\mathbb{P}}}_n$ (Lemma 1). Hence, $P_n^{†}$ is uniquely determined. By language invariance we obtain P^† ∈ arg ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$S_{\mathrm{g}}^n(P,P)$ for all n ≥ K. Thus, P^† ∈ maxent ${\mathbb{E}}_{\mathrm{ℒ}}$.

For Q ∈ $[{\mathbb{E}}_{\mathrm{ℒ}}]$ \ {P^†} there has to exist some N ∈ $\mathrm{\mathbb{N}}$ such than Q_⇂n ≠ P^†_⇂n for all n ≥ N. Since $H_{\mathrm{g}}^n$ is a strictly concave function on ${\mathrm{\mathbb{P}}}_n$ and since P^† maximises $H_{\mathrm{g}}^n$ for all n ≥ K it follows that $H_{\mathrm{g}}^n(P^{†})>H_{\mathrm{g}}^n(Q)$ for all n ≥ max{K, N}. Thus, Q ∉ maxent ${\mathbb{E}}_{\mathrm{ℒ}}$.

From Theorem 5 we have that $P_n^{†}$ ∈ arg ${\inf }_{B\in {\mathbb{B}}_{\mathrm{ℒ}}}$${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$S_{\mathrm{g}}^n(P,B)$ for all n ≥ K. Since ${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated and g is language invariant we have that P^† ∈ arg ${\inf }_{B\in {\mathbb{B}}_{\mathrm{ℒ}}}$${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$S_{\mathrm{g}}^n(P,B)$ for all n ≥ K. Thus, P^† ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$.

For every C ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$\{P^†} there has to exist an N ∈ $\mathrm{\mathbb{N}}$ such that for all n ≥ N it holds that $C_{\downharpoonright n}\ne P_{\downharpoonright n}^{†}$ For all n ≥ max{K, N} we now apply Theorem 5 to obtain ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$S_{\mathrm{g}}^n(P,C)>{\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$S_{\mathrm{g}}^n(P,P^{†})$. Hence, C ∉ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$. □

This result is not entirely satisfactory, because we cannot say anything yet about whether such weighting functions exist. Indeed, it was conjectured in Landes and Williamson [4] (p. 3564) that no inclusive, symmetric and refined weighting function $\mathrm{g}$ is language invariant. This conjecture remains open.

Our next result says that, for the standard weighting ${\mathrm{g}}_{\mathrm{\Omega }}$, the probability function with the best loss profile is the standard entropy maximiser:

Proposition 15 (Standard entropy minimax). If${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated and$\mathrm{g}={\mathrm{g}}_{\mathrm{\Omega }}$, then

$$\min \mathrm{loss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}=\max \mathrm{ent}{\mathbb{E}}_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}^{†}\}.$$

Proof.$\{P_{\mathrm{\Omega }}^{†}\}=\max \mathrm{ent}{\mathbb{E}}_{\mathrm{ℒ}}$ follows directly, since ${\mathrm{g}}_{\mathrm{\Omega }}$ is language-invariant and state-inclusive, Proposition 8.

It is well-known that

$$\arg \underset{Q\in {\mathrm{\mathbb{P}}}_n}{\inf }\underset{P\in {\mathbb{E}}_n}{\sup }{S}_{\mathrm{g}\mathrm{\Omega }}(P,Q)=\arg \underset{P\in {\mathbb{E}}_n}{\sup }{S}_{\mathrm{g}\mathrm{\Omega }}(P,P)=\{P_{\mathrm{g}\mathrm{\Omega }}^{†}\},$$

see for instance [15]. Hence,

$$\min \mathrm{loss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}=\max \mathrm{ent}{\mathbb{E}}_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}^{†}\}.$$

□

Because it only identifies probability functions with the best loss profile, rather than normalised belief functions with the best loss profile, Proposition 15 provides a justification for only two norms of objective Bayesianism, the Calibration Norm and the Equivocation Norm, under the supposition that $\mathrm{g}={\mathrm{g}}_{\mathrm{\Omega }}$. This is a useful result if there is some independent reason—such as the Dutch book argument—for taking belief functions to be probability functions. But our goal in this paper is to investigate the extent to which the notion of loss profile developed above can be used to justify all three norms at once.

We know that there are weighting functions that are regular, i.e., which are atomic, inclusive, symmetric and strongly refined. The plan of the rest this section is to prove the following analogous minimax theorem for regular weighting functions. This says that, for any regular weighting function, the belief function with the best loss profile is the probability function in ${\mathbb{E}}_{\mathrm{ℒ}}$ which has maximal standard entropy. This theorem thus justifies all three norms at once.

Theorem 6 (Regularity minimax). If$\mathrm{g}$ is regular and${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated, then

$$\mathrm{minloss}{\mathbb{B}}_{\mathrm{ℒ}}=\max \mathrm{ent}{\mathbb{E}}_{\mathrm{ℒ}}={\mathrm{\mathbb{P}}}^{†}=\{P_{\mathrm{\Omega }}^{†}\}.$$

In order to prove this theorem we give a number of lemmata. We shall state these lemmata under more minimal conditions on $\mathrm{g}$. The reader not interested in the details might always replace the stated conditions on $\mathrm{g}$ by: “ $\mathrm{g}$ is regular”.

To begin with, we shall consider only belief functions B which respect logical equivalence. (Later we shall relax this restriction.) Hence, $S_{\mathrm{g},\rho }^n(P,B)$ does not depend on ρ and we can ignore the particular representation ρ. This will allow us to focus on propositions.

Lemma 7. If n ≥ K, Q ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ and if${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$S_{\mathrm{\Omega }}^n(P,Q)$ is finite, then it holds that

$$\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^{n+1}(P,Q)\ge \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q)+\log \frac{|{\mathrm{\Omega }}_{n+1}|}{|{\mathrm{\Omega }}_n|}.$$

Proof. Let P^′ ∈ arg ${\sup }_{P\in {\mathbb{E}}_{\mathrm{\ell }}}{S}_{\mathrm{\Omega }}^n(P,Q)$. Then define P″ on Ω_n+1 by $P^{″}(v):=P^{\prime }({\omega }_v)\frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_{n+1}|}$ for all ν ∈ Ω_n+1 and ω_ν ∈ Ω_n with $v|={\omega }_v$. Now extend P″ arbitrarily to a function in $[{\mathbb{E}}_{\mathrm{ℒ}}]$. Note that ${P^{″}}_{\downharpoonright n+1}\in [{\mathbb{E}}_{n+1}]$ since ${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated and n ≥ K.

Since − log(x) is a strictly convex function on (0, 1] and since $Q(w)={\displaystyle {\sum }_{\underset{\nu |=\omega }{\nu \in {\mathrm{\Omega }}_{n+1}}}Q(v)}$ for all ω ∈ Ω_n it holds for all fixed ω ∈ Ω_n that ${\displaystyle {\sum }_{\underset{\nu |=\omega }{\nu \in {\mathrm{\Omega }}_{n+1}}}-\log Q(v)}\ge -\frac{|{\mathrm{\Omega }}_{n+1}|}{|{\mathrm{\Omega }}_n|}\log \left(\frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_{n+1}|}Q(\omega )\right)$. We now find

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^{n+1}(P,Q)\ge S_{\mathrm{\Omega }}^{n+1}(P^{″},Q)\\ =-{\displaystyle \sum _{\nu \in {\mathrm{\Omega }}_{n+1}}{P}^{″}(\nu )}\log Q(\nu )\\ =-{\displaystyle \sum _{\nu \in {\mathrm{\Omega }}_{n+1}}{P}^{\prime }({\omega }_{\nu })\frac{|{\mathrm{\Omega }}_n|}{{\mathrm{\Omega }}_{n+1}}}\log Q(\nu )\\ \ge -{\displaystyle \sum _{w\in {\mathrm{\Omega }}_n}{P}^{\prime }(\omega )·\log \frac{|{\mathrm{\Omega }}_n|·Q(\omega )}{|{\mathrm{\Omega }}_{n+1}|}}\\ =-\log \frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_{n+1}|}-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_n}{P}^{\prime }(\omega )·}\log Q(\omega )\\ =\log \frac{|{\mathrm{\Omega }}_{n+1}|}{|{\mathrm{\Omega }}_n|}+\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q).\end{array}$$

Definition 22 (γ-weighting). To simplify notation we define for n ∈ N and F ⊆ Ω_n

$${\gamma }_n(F):={\displaystyle \sum _{\underset{F\in \pi }{\pi \in {\mathrm{\Pi }}_n}}{g}_n(\pi )}.$$

If g is symmetric, then γ_n(F ) only depends on |F | := |{ω ∈ Ω_n : ω ∈ F }| and we write γ_n(|F |).

In particular, since the belief function B is assumed to respect logical equivalence, we can write

$$\begin{array}{l}{S}_g^n(P,B)=\underset{\rho \in \varrho n}{\sup }{\displaystyle \sum _{F\subseteq {\mathrm{\Omega }}_n}-{\gamma }_n(F)P(\rho F)}\log B(\rho F)\\ ={\displaystyle \sum _{F\subseteq {\mathrm{\Omega }}_n}-{\gamma }_n{(F)}^{\circ }P(\rho F)}{\log }^{\circ }B(\rho F).\end{array}$$

Furthermore, we can easily characterise the set of inclusive g. g is inclusive, if and only if for all $n\in \mathrm{\mathbb{N}}$ and all F ⊆ Ω_n γ_n(F) > 0.

Lemma 8. Let g be inclusive and such that there exist 0 < a ≤ b < +∞ such that g(πⁿ) ∈ [a, b] for all$n\in \mathrm{\mathbb{N}}$ and such that

$$\underset{n\to \mathrm{\infty }}{\lim }\log |{\mathrm{\Omega }}_n|{\displaystyle \sum _{\pi \in {\prod }_n\backslash \{{\pi }^n\}}g(\pi )}=0.$$

Then

$$Res{t}_n:=\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,P_{\mathrm{\Omega }}^{†})-g({\pi }^n)S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})\to 0asn\to \mathrm{\infty }.$$

Proof. Let us thus first note that

$$S_g^n(P,P_{\mathrm{\Omega }}^{†})-g({\pi }^n)S_{\mathrm{\Omega }}^n(P,P_{\mathrm{\Omega }}^{†})={\displaystyle \sum _{\pi \in {\prod }_n\backslash \{{\pi }^n\}}-g(\pi ){\displaystyle \sum _{F\in \pi }°P(F)\log °P_{\mathrm{\Omega }}^{†}(F).}}$$

(10)

Recall that $P_{\mathrm{\Omega }}^{†}$ is open-minded (Proposition 5). Thus, $P\in [{\mathbb{E}}_{\mathrm{ℒ}}]$, F ⊆ Ω_n and $°P(F)>0$ imply $°P_{\mathrm{\Omega }}^{†}(F)>0$. Let

$$m:=\min \{P_{\mathrm{\Omega }}^{†}(\omega ):\omega \in {\mathrm{\Omega }}_K\&P_{\mathrm{\Omega }}^{†}(\omega )>0\}ϵ(0,1].$$

Then, for F ⊆ Ω_n such that $°P_{\mathrm{\Omega }}^{†}(F)>0$ it holds that

$$\begin{array}{c}°P_{\mathrm{\Omega }}^{†}(F)\ge \min \{P_{\mathrm{\Omega }}^{†}(\nu ):\nu \in {\mathrm{\Omega }}_n\&P_{\mathrm{\Omega }}^{†}(\nu )>0\}\\ =m·\frac{|{\mathrm{\Omega }}_K|}{|{\mathrm{\Omega }}_n|}\ge \frac{m}{|{\mathrm{\Omega }}_n|},\end{array}$$

since $P_{\mathrm{\Omega }}^{†}$ equivocates beyond ${\mathrm{ℒ}}_K$.

Hence, $P\in [{\mathbb{E}}_{\mathrm{ℒ}}]$, F ⊆ Ω_n and $°P(F)>0$ imply that $°P_{\mathrm{\Omega }}^{†}(F)\ge \frac{m}{|{\mathrm{\Omega }}_n|}$. Since ${\displaystyle {\sum }_{F\in \pi }°P(F)}=1$ we now find

$$\begin{array}{l}0\le \underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_g^n(P,P_{\mathrm{\Omega }}^{†})-g({\pi }^n)S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})\\ \le \underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }g({\pi }^n)S_{\mathrm{\Omega }}^n(P,P_{\mathrm{\Omega }}^{†})\\ +\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{\displaystyle \sum _{\pi \in {\displaystyle {\prod }_n\backslash \{{\pi }^n\}}}-g(\pi ){\displaystyle \sum _{F\in \pi }°P(F)\log °P_{\mathrm{\Omega }}^{†}(F)}}\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }g({\pi }^n)S_{\mathrm{\Omega }}^n(P,P_{\mathrm{\Omega }}^{†})\\ \le \underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{\displaystyle \sum _{\pi \in {\displaystyle {\prod }_n\backslash \{{\pi }^n\}}}-g(\pi ){\displaystyle \sum _{F\in \pi }°P(F)\log °}}\frac{m}{|{\mathrm{\Omega }}_n|}\\ =\log \frac{m}{|{\mathrm{\Omega }}_n|}{\displaystyle \sum _{\pi \in {\displaystyle {\prod }_n\backslash \{{\pi }^n\}}}-g(\pi )}\\ =\left(\log \left(|{\mathrm{\Omega }}_n|\right)-\log (m)\right)·{\displaystyle \sum _{\pi \in {\displaystyle {\prod }_n\backslash \{{\pi }^n\}}}g(\pi )}\end{array}$$

To complete the proof, it suffices to note that this sums is eventually positive and converges in $n\in \mathrm{\mathbb{N}}$ to zero by our assumption on g and the fact that m is constant.

Proposition 16. Let g be inclusive and such that there exist 0 < a ≤ b < +∞ such that g(πⁿ) ∈ [a, b] for all$n\in \mathrm{\mathbb{N}}$ and such that

$$\underset{n\to \mathrm{\infty }}{\lim }\log |{\mathrm{\Omega }}_n|{\displaystyle \sum _{\pi \in {\prod }_n\backslash \{{\pi }^n\}}g(\pi )=0.}$$

Then for all$B\in {\mathbb{B}}_{\mathrm{ℒ}}\backslash \{P_{\mathrm{\Omega }}^{†}\}$ that respect logical equivalence, $P_{\mathrm{\Omega }}^{†}\prec B$.

Proof. We shall proceed by considering cases.\

Case 1$B\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\backslash \{P_{\mathrm{\Omega }}^{†}\}$.

There exists an N ≥ K such that for all n ≥ N it holds that $B_{\downharpoonright n}\ne {(P_{\mathrm{\Omega }}^{†})}_{\downharpoonright n}$. It is well-known that for all $P\in \mathrm{\mathbb{P}}$

$$\arg \underset{Q\in \mathrm{\mathbb{P}}}{\inf }-{\displaystyle \sum _{\omega \in \mathrm{\Omega }}P(\omega )}\log Q(\omega )=\{P\}.$$

(11)

That is, the usual logarithmic scoring rule, when applied to probability functions $P\in \mathrm{\mathbb{P}}$ and $Q\in \mathrm{\mathbb{P}}$, is strictly proper. Savage [16] showed that this scoring rule is not only strictly proper but also unique under the further assumption of locality, which is requirement L3 in our framework. Thus, $S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},B)-S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})>0$.

We then find by the first part of Corollary 3 and Lemma 7 for all n ≥ N that

$$\begin{array}{l}\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_g^n(P,B)-\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_g^n(P,P_{\mathrm{\Omega }}^{†})\\ =\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_g^n(P,B)-g({\pi }^n)S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})-Res{t}_n\\ \ge g({\pi }^n)\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,B)-g({\pi }^n)S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})-Res{t}_n\\ =g({\pi }^n)\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,B)-g({\pi }^n)(S_{\mathrm{\Omega }}^N(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})+\log \frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_n|})-Res{t}_n\\ \ge g({\pi }^n)\left(\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_{\mathrm{\Omega }}^N(P,B)+\log \frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_n|}\right)\\ -g({\pi }^n)\left(S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})+\log \frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_n|}\right)-Res{t}_n\\ \ge -g({\pi }^n)\left(S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},B)-S_{\mathrm{\Omega }}^N(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})\right)-Res{t}_n\end{array}$$

Recall from Lemma 8 that Rest_n converges to zero. Furthermore, the sequence ${\left(g\left({\pi }^n\right)\right)}_n{{}_{\in }}_{\mathrm{\mathbb{N}}}$ is bounded in [a, b] with a > 0. Thus, for all large enough n ∈ N it holds that

$$\begin{array}{c}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B)-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,P_{\mathrm{\Omega }}^{†})\ge g({\pi }^n)\left(S_{\mathrm{\Omega }}^N(P_{\mathrm{\Omega }}^{†},B)-(S_{\mathrm{\Omega }}^N(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})\right)-Res{t}_n\\ >0.\end{array}$$

Case 2$B\in {\mathbb{B}}_{\mathrm{ℒ}}\backslash {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$.

Case 2A There exists a $P_B\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ such that for all $n\in \mathrm{\mathbb{N}}$ and all F ⊆ Ω_n it holds that $°B(F)\le °P_B(F)$, i.e., P_B dominates B.

Case 2Ai$P_B=P_{\mathrm{\Omega }}^{†}$ and no other $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ is such that $°B(F)\le °P(F)$ for all n and all F ⊆ Ω_n. Then for all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ and all propositions F it holds that

$${\gamma }_n(F)°P(F)(-\log °B(F)+\log °P_{\mathrm{\Omega }}^{†}(F))\ge 0.$$

Thus, for all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ and $n\in \mathrm{\mathbb{N}}$ it holds that $S_g^n(P,B)\ge S_g^n(P,P_{\mathrm{\Omega }}^{†})$.

Since $B\ne P_{\mathrm{\Omega }}^{†}$ there exists some $N\in \mathrm{\mathbb{N}}$ and a ∅ ⊂ F ⊆ Ω_N such that $°B(F)<°P_{\mathrm{\Omega }}^{†}(F)$. For n > N let ∅ ⊂ F_n ⊆ Ω_n be such that F_n = {ω ∈ Ω_n : ω ∈ F }. Hence, for all n > N it holds that $-\log °B(F_n)+\log °P_{\mathrm{\Omega }}^{†}(F_n)>0$. Thus, $°P_{\mathrm{\Omega }}^{†}(F_n){\gamma }_n(F_n)(-\log °B(F_n)+\log °P_{\mathrm{\Omega }}^{†}(F_n))>0$. Since g is inclusive (γ_n(F ) > 0 for all $n\in \mathrm{\mathbb{N}}$ and all F ⊆ Ω_n) it holds that $S_g^n(P_{\mathrm{\Omega }}^{†},B)>S_g^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})$ for all n ≥ N.

Applying the second condition of Definition 21 yields $P_{\mathrm{\Omega }}^{†}\prec B$.

Case 2Aii There exists a $P_B\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ dominating B such that $P_B\ne P_{\mathrm{\Omega }}^{†}$.

Then for all n ≥ K and all $P\in {\mathbb{E}}_{\mathrm{ℒ}}$ it holds that $S_g^n(P,B)-S_g^n(P,P_B)\ge 0$. For all large enough $n\in \mathrm{\mathbb{N}}$ it holds by Case 1 that ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n(P,P_B)-{\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n(P,P_{\mathrm{\Omega }}^{†})>0$. Thus, we find for all large enough n

$$\begin{array}{c}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B)-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,P_{\mathrm{\Omega }}^{†})\ge \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,P_B)-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,P_{\mathrm{\Omega }}^{†})\\ >0.\end{array}$$

Cas 2B There does not exist a $P_B\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ such that for all $n\in \mathrm{\mathbb{N}}$ and all F ⊆ Ω_n it holds that $°B(F)\le °P_B(F)$.

For example, the belief functions constructed in Proposition 4 are of this form, i.e., not dominated by a probability function.

Let us assume for contradiction that there exists an infinite set $J:=\{j_1,j_2,\dots \}\subseteq \mathrm{\mathbb{N}}$ such that ${\lim }_{i\to \mathrm{\infty }}{\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_{j_i}}B(\omega )}=1$. Now define a function Q on $S\mathrm{ℒ}$ by requiring that Q respects logical equivalence and that

$$°Q(F):=\underset{i\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\underset{\omega \in F}{\omega \in {\mathrm{\Omega }}_{j_i}}}B(\omega )}.$$

Next we show $Q\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ and $°B(F)\le °Q(F)$ for all F which will allow us to derive the required contradiction.

First note that for all $n\in \mathrm{\mathbb{N}}$ it holds that

$$\begin{array}{l}{\displaystyle \sum _{\nu \in {\mathrm{\Omega }}_n}Q(\nu )}=\underset{i\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\nu \in {\mathrm{\Omega }}_n}{\displaystyle \sum _{\underset{\omega |=\nu }{\omega \in {\mathrm{\Omega }}_{j_i}}}B(\omega )}}\\ =\underset{i\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\underset{\omega |=\nu }{\omega \in {\mathrm{\Omega }}_{j_i}}}B(\omega )}\\ =1.\end{array}$$

Furthermore, we have for all $n\in \mathrm{\mathbb{N}}$ and all F ⊆ Ω_n

$$\begin{array}{l}°Q(F)=\underset{i\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\underset{\omega \in F}{\omega \in {\mathrm{\Omega }}_{j_i}}}B(\omega )}\\ =\underset{i\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\underset{\nu \in F}{\nu \in {\mathrm{\Omega }}_n}}{\displaystyle \sum _{\underset{\omega |=\nu }{\omega \in {\mathrm{\Omega }}_{j_i}}}B(\omega )}}\\ ={\displaystyle \sum _{\underset{\nu \in F}{\nu \in {\mathrm{\Omega }}_n}}\underset{i\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\underset{\omega |=\nu }{\omega \in {\mathrm{\Omega }}_{j_i}}}B(\omega )}}\end{array}$$

So, $Q\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$.

Now assume that there exists a proposition F ⊆ Ω_n such that $°B(F)>°Q(F)$. Since $Q\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ it holds that $°Q(F)+°Q(\overline{F})=1$. Note that

$$\{\omega \in {\mathrm{\Omega }}_{j_i}:\omega \in F\}\cup {\displaystyle \underset{\underset{\omega \in F}{\omega \in {\mathrm{\Omega }}_{j_i}}}{\cup }\{\omega \}}$$

is a partition in ${\mathrm{\Pi }}_{j_i}$. Since we assumed that B respects logical equivalence it holds that $B({\vee }_{\omega \in \mathrm{\Omega }{}_{i_i}:\omega \in F}\omega )$. Thus,

$$°B(F)+{\displaystyle \sum _{\underset{\omega \in F}{\omega \in {\mathrm{\Omega }}_{j_i}}}B(\omega )}\le 1$$

has to hold for all large i. We now obtain the required contradiction as follows:

$$\begin{array}{l}1\ge \underset{i\to \mathrm{\infty }}{\lim }\left(°B(F)+{\displaystyle \sum _{\underset{\omega \in \overline{F}}{\omega \in {\mathrm{\Omega }}_{j_i}}}B(\omega )}\right)\\ =°B(F)+°Q(\overline{F})\\ >°Q(F)+°Q(\overline{F})\\ =1\end{array}$$

Thus, there has to exist an α > 0 and an $N\in \mathrm{\mathbb{N}}$ with N ≥ K such that for all n ≥ N it holds that ${\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_n}B(\omega )\le 1-\alpha }$. We have for n ≥ N that

$$\begin{array}{l}\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_g^n(P,P_B)-\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_g^n(P,P_{\mathrm{\Omega }}^{†})=\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_g^n(P,B)-g({\pi }^n)S_g^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})-Res{t}_n\\ \ge g({\pi }^n)\left(\underset{{}_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,B)-S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})\right)-Res{t}_n\\ \ge g({\pi }^n)\left(S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},B)-S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})\right)-Res{t}_n\end{array}$$

To complete the proof we will now show that there exists some β > 0, which depends on ${\mathbb{E}}_{\mathrm{ℒ}}$ and g but does not depend on the particular n ≥ N, such that $S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},B)>S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})>\beta$. Since g(πⁿ) is bounded, we then obtain that ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n(P,B)-{\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n(P,P_{\mathrm{\Omega }}^{†})>0$ for all large enough n.

We need to show that for all large enough n,

$$-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_n}{P}_{\mathrm{\Omega }}^{†}(\omega )}\log f(\omega )-S_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†})\ge \beta >0$$

for all functions f : Ω_n → [0, 1] such that ${\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_n}f(\omega )\le 1-\alpha }$.

Suppose $f^{\prime }\in \arg {\min }_f{\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_n}-P_{\mathrm{\Omega }}^{†}(\omega )}\log f(\omega )$. If $P_{\mathrm{\Omega }}^{†}(\omega )>0$ and f′(ω) = 0, then ${\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_n}-P_{\mathrm{\Omega }}^{†}(\omega )}\log f^{\prime }(\omega )=\mathrm{\infty }$. Hence, the minimum cannot obtain for such an f′. On the other hand, if f′(ω) > 0 and $P_{\mathrm{\Omega }}^{†}(\omega )=0$, then there has to exist a μ ∈ Ω_n \ {ω} such that $P_{\mathrm{\Omega }}^{†}(\mu )>0$. Then define a function f″ such that f″ (ω) := 0, f″ (μ) := f′ (μ) + f′ (ω) > f′ (μ) and f″ (λ) := f′ (λ) for all λ ∈ Ω_n \ {ω, μ}. Then ${\displaystyle {\sum }_{\nu \in {\mathrm{\Omega }}_n}-P_{\mathrm{\Omega }}^{†}(\nu )\log f^{\prime }}(\nu )>{\displaystyle {\sum }_{\nu \in {\mathrm{\Omega }}_n}-P_{\mathrm{\Omega }}^{†}(\nu )\log f^{″}}(\nu )$. Again, the minimum cannot obtain for such an f′.

We may thus assume in the following that any f′ minimising the above sum satisfies: $P_{\mathrm{\Omega }}^{†}(\omega )>0$, if and only if f′(ω) > 0. In particular, the function f′(ω) = 0 for all ω ∈ Ω_n cannot be optimal.

Let $a_f:={\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_n}f(\omega )ϵ(0,1-\alpha ]}$. Then

$$\begin{array}{r}-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_n}{P}_{\mathrm{\Omega }}^{†}(\omega )\log f(\omega )=-}{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_n}{P}_{\mathrm{\Omega }}^{†}(\omega )}\left(\log \frac{f(\omega )}{a_f}+\log a_f\right)\\ =-\log (a_f)-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_n}{P}_{\mathrm{\Omega }}^{†}(\omega )\log \frac{f(\omega )}{a_f}.}\end{array}$$

By definition, ${\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_n}\frac{f(\omega )}{a_f}=1}$. The sum in the above equation is thus standard logarithmic scoring rule on ${\mathbb{B}}_n$, $S_{\mathrm{\Omega }}^n\left(P,\frac{f}{a_f}\right)$. For fixed P ∈ ℙ_$ℒ$ the minimum under this scoring rule obtains for a function which agrees with P on the states ω ∈ Ω_n.

Thus, for fixed a_f the function f minimising $-{\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_n}{P}_{\mathrm{\Omega }}^{†}(\omega )\log f(\omega )}$ is the a_f multiple of $P_{\mathrm{\Omega }}^{†}$. In order to minimize $-{\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_n}{P}_{\mathrm{\Omega }}^{†}(\omega )\log f(\omega )}$, −log a_f has to be minimal. This minimum obtains for a_f = 1 − α. We hence find the value of the minimum as

$$\underset{{\displaystyle {\sum }_{\omega \in {\mathrm{\Omega }}_n}f(\nu )\le 1-\alpha }}{\overset{\inf }{f:{\mathrm{\Omega }}_n\to [0.1]}}-{\displaystyle \sum _{\omega \in {\mathrm{\Omega }}_n}{P}_{\mathrm{\Omega }}^{†}(\omega )\log f(\omega )=-\log (}1-\alpha )-S_{\mathrm{\Omega }}^n\left(P_{\mathrm{\Omega }}^{†},P_{\mathrm{\Omega }}^{†}\right).$$

β may thus be chosen as β = − log(1 − α) > 0. □

We now drop the assumption that belief functions respect logical equivalence.

Proposition 17. If g is inclusive and such that there exist 0 < a ≤ b < +∞ such that g(πⁿ) ∈ [a, b] for all n ∈ ℕ and such that

$$\underset{n\to \mathrm{\infty }}{\lim }\log |{\mathrm{\Omega }}_n|{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}g(\pi )=0,}$$

then

$$\mathrm{minloss}{\mathbb{B}}_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}^{†}\}.$$

(12)

Proof. We shall consider cases for $B\in {\mathbb{B}}_{\mathrm{ℒ}}\backslash \{P_{\mathrm{\Omega }}^{†}\}$. We will show that $P_{\mathrm{\Omega }}^{†}\prec B$ holds for all cases. Then minloss ${\mathbb{B}}_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}^{†}\}$ follows.

Case 1 B respects logical equivalence.

By Proposition 16 we obtain $P_{\mathrm{\Omega }}^{†}\prec B$.

Case 2 B does not respect logical equivalence.

Since B does not respect logical equivalence, there exists a minimal N ∈ ℕ such that two different logically equivalent sentences φ, ψ ∈ S$ℒ$_N are assigned different degrees of belief, i.e., B(φ) ≠ B(ψ).

We now inductively define functions B_n : S$ℒ$→ [0, 1] for n ≥ N. First, let

$$B_N(\chi ):=\{\begin{array}{ll}\inf \{B(\theta ):\theta \in S{\mathrm{ℒ}}_N\&\models \chi \leftrightarrow \theta \}\hfill & \mathrm{if}\chi \in S{\mathrm{ℒ}}_N\hfill \\ B(\chi )\hfill & \mathrm{if}\chi \in S\mathrm{ℒ}\backslash S{\mathrm{ℒ}}_N\hfill \end{array}.$$

Now assume n > N. For all χ ∈ S$ℒ$_n such that no θ ∈ S$ℒ$_n−1 is logically equivalent to χ let

$$B_n(\chi ):=\inf \{B(\theta ):\theta \in S{\mathrm{ℒ}}_n\&\models \chi \leftrightarrow \theta \}$$

and otherwise let

$$B_n(\chi ):=\{\begin{array}{ll}{B}_{n-1}(\theta )\hfill & \mathrm{if}\chi \in S{\mathrm{ℒ}}_n\text{and there exists a}\theta \in S{\mathrm{ℒ}}_{n-1}\mathrm{with}\models \chi \leftrightarrow \theta \hfill \\ B(\chi )\hfill & \mathrm{if}\chi \in S\mathrm{ℒ}\backslash S{\mathrm{ℒ}}_n\hfill \end{array}.$$

Note that B_n is well-defined, B_n−1 respects logical equivalence on $ℒ$_n−1 and thus B_n−1(θ) does not depend on the particular sentence θ ∈ S $ℒ$_n−1 which is logically equivalent to χ.

By construction, B_n+1 agrees with B_n on S $ℒ$_n.

Finally, let B^I(χ) := lim_n→∞ B_n(χ). Trivially, B^I_⇂N = B_N⇂N.

Since for all n ≥ N the B_n respect logical equivalence on $ℒ$_n, B^I respects logical equivalence on $ℒ$.

Furthermore, B^I agrees with B_n on the sentences of $ℒ$_n.

Now consider a χ ∈ S$ℒ$ and let k ∈ ℕ be minimal such that χ ∈ S$ℒ$_k and consider the corresponding proposition F ⊆ Ω_k. For all n ≥ max{N, k} we shall show that

$$\underset{\rho \in {\varrho }_n}{\inf }B(\rho F)\le B^I(\chi ).$$

If k ≤ N, then for all n ≥ N it holds that B_n(χ) = inf{B(θ) : θ ∈ S$ℒ$_N & ⊨χ ↔ θ} = B_N(χ). Hence, B^I(χ) = B_N(χ). For n ≥ N there exist ρ ∈ ϱ_n such that ρF = χ. Thus, ${\inf }_{\rho \in {\varrho }_n}B(\rho F)\le B_N(\chi )=B^I(\chi )$.

If k ≥ N, then there are two cases. If no θ ∈ S$ℒ$_k−1 is logically equivalent to χ, then B_k(χ) = inf{B(θ) : θ ∈ S$ℒ$_k \ S$ℒ$_k−1 & ⊨ χ ↔ θ}. In which case, we find for all n ≥ k > N

$$\begin{array}{l}\underset{\rho \in {\varrho }_n}{\inf }B(\rho F)\le \underset{\rho \in {\varrho }_k}{\inf }B(\rho F)\\ =\inf \{B(\theta ):\theta \in S{\mathrm{ℒ}}_k\backslash S{\mathrm{ℒ}}_{k-1}\&\models \chi \leftrightarrow \theta \}\\ =B^I(\chi ).\end{array}$$

In the other case there does exist some θ ∈ S$ℒ$_k−1 which is logically equivalent to χ. Then B_n(χ) = B_k−1(θ) for all n ≥ k. So B^I(χ) = B_k−1(θ). Thus, for all n ≥ max{N, k} ≥ k − 1 it is true that

$$\begin{array}{l}\underset{\rho \in {\varrho }_n}{\inf }B(\rho F)\le \underset{\rho \in {\varrho }_k}{\inf }B(\rho F)\\ \le \underset{\rho \in {\varrho }_{\max }\{N,k\}}{\inf }B(\rho F)\\ =\inf \{B(\theta ):\theta \in S{\mathrm{ℒ}}_{k-1}\&\models \chi \leftrightarrow \theta \}\\ =B^I(\chi ).\end{array}$$

It thus follows for all P ∈ ℙ_$ℒ$ and all n ≥ N that

$$\begin{array}{l}{S}_g^n(P,B)=\underset{\rho \in {\varrho }_n}{\sup }{S}_{g,\rho }^n(P,B)\\ =-{\displaystyle \sum _{F\subseteq {\mathrm{\Omega }}_n}{\gamma }_n(F)°P(F)}\underset{\rho \in {\varrho }_n}{\inf }\log B(\rho F)\\ \ge -{\displaystyle \sum _{F\subseteq {\mathrm{\Omega }}_n}{\gamma }_n(F)°P(F)\log B^I(\rho F)}\text{for all}\rho \in {\varrho }_n\\ =S_g^n(P,B^I).\end{array}$$

(13)

Let us now note that B^I(φ) < max{B(φ), B(ψ)}. Thus, B^I(φ) + B^I(¬φ) < max{B(φ), B(ψ)} + B^I(¬φ). Also observe that B^I(χ) ≤ B(χ) for all χ ∈ S$ℒ$_N. Thus, B^I(¬φ) ≤ B(¬φ). Hence,

$$\begin{array}{l}{B}^I(\phi )+B^I(\neg \phi )<\max \{B(\phi ),B(\psi )\}+B^I(\neg \phi )\\ \le \max \{B(\phi ),B(\psi )\}+B(\neg \phi )\\ \le 1.\end{array}$$

We infer B^I(φ) + B^I(¬φ) < 1 and thus B^I ∉ ℙ_$ℒ$.

Case 2A$B^I\in {\mathbb{B}}_{\mathrm{ℒ}}\backslash {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$.

Since B^I respects logical equivalence, we obtain by Proposition 16 that $P_{\mathrm{\Omega }}^{†}\prec B^I$. Applying (13) we obtain $P_{\mathrm{\Omega }}^{†}\prec B$.

Case 2B$B^I\notin {\mathbb{B}}_{\mathrm{ℒ}}$.

We shall now define a function B^J assigning every proposition a value in [0, 1] as follows. Let τ ∈ S$ℒ$ be some tautology. {τ} is a partition. Since $B^I\notin {\mathbb{B}}_{\mathrm{ℒ}}$ it follows that B^I(τ) < 1. Now put B^J(κ) := 1 − B^I(τ) for all contradictions κ ∈ S$ℒ$. Clearly, B^J(κ) > 0. For all satisfiable χ ∈ S$ℒ$ let B^J (χ) := B^I(χ).

Note that $B^J\notin {\mathbb{B}}_{\mathrm{ℒ}}$ and since B^J(¬τ) > 0 it follows that $B^J\in {\mathbb{B}}_{\mathrm{ℒ}}\backslash {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$. Also note that for all n ∈ ℕ and all P ∈ ℙ_$ℒ$ it holds that $S_g^n(P,B^I)=S_g^n(P,B^J)$ and so

$$S_g^n(P,B)\ge S_g^n(P,B^I)=S_g^n(P,B^J).$$

Since B^J respects logical equivalence we can apply Case 2A to obtain $P_{\mathrm{\Omega }}^{†}\prec B^J$. But then $P_{\mathrm{\Omega }}^{†}\prec B$. □

Our main minimax theorem (already stated above on Page 2492) then follows immediately from Proposition 17 by applying Lemma 2 and Theorem 3:

Theorem 6 (Regularity minimax). If g is regular and${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated, then

$${\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}={\mathrm{maxent}\mathbb{E}}_{\mathrm{ℒ}}={\mathrm{\mathbb{P}}}^{†}=\{P_{\mathrm{\Omega }}^{†}\}.$$

If ${\mathbb{E}}_{\mathrm{ℒ}}={\mathcal{P}}_{\mathrm{ℒ}}$, then the unique function with greatest entropy is the equivocator (Proposition 7). Thus by Theorem 6,

$${\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}=\mathrm{maxent}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}^{†}\}=\{P_{=}\}.$$

Recall that P= assigns all n-states ω ∈ Ω_n the same probability, $P_{=}(\omega )=\frac{1}{|{\mathrm{\Omega }}_n|}$. So, if the agent does not possess any evidence then all n-states ω ∈ Ω_n are all believed to the same degree. Absence of evidence entails symmetric degrees of belief. In other words, the three norms of objective Bayesianism entail an instance of the Principle of Indifference.

Surprisingly, perhaps, symmetry of the weighting function is not necessary to guarantee this instance of the Principle of Indifference on finite sublanguages—see Appendix B.

4.5. Infinite-Language Invariance

So far, we have been working over a fixed predicate language $ℒ$ (without quantifiers). One might wonder what would have happened if one had started out with a different such language.

We will investigate this question by considering predicate languages which contain finitely many further relation symbols and/or finitely many further constant symbols than does $ℒ$.

For all languages we consider here, we shall suppose that the ways the constant symbols are ordered are consistent. Furthermore, we suppose that the order types of the constant symbols are ω, the first infinite ordinal. That is, for $ℒ$ ⊂ $ℒ$¹ let t₁, t₂, … be the constant symbols in $ℒ$ and let $T^{new}:=\{t_1^{new},\dots ,t_m^{new}\}$ be the set of constant symbols in $ℒ$¹ which are not in $ℒ$. Then we require that the constant symbols of $ℒ$¹ are ordered such that

• for all n ∈ ℕ, t_n appears before t_n+1 (consistency),
• for all t ∈ T ^new there exists some n ∈ ℕ such that t appears before t_n (order type ω).

The way the constant symbols of $ℒ$¹ are ordered can be thought of as inserting the t ∈ T^new into the ordering of the constant symbols of $ℒ$.

From now on, superscripts are used to refer to such predicate languages, while subscripts continue to refer to their respective finite sublanguages. For example, ${\mathrm{ℒ}}_n^1$ is the finite sublanguage of $ℒ$¹ which contains only the first n constants of $ℒ$¹. For $ℒ$ ⊂ $ℒ$¹, in general, the set of the first n constants of $ℒ$ may be different from the set of the first n constants of $ℒ$¹.

Definition 23 (Infinite-Language Invariance). A weighting function g is infinite-language invariant, if and only if the following holds: for all $ℒ$ and for all${\mathbb{E}}_{\mathrm{ℒ}}$ finitely generated by constraints on the finite sublanguage $ℒ$_K of $ℒ$, if $ℒ$¹ and $ℒ$² are such that $ℒ$ ⊆ $ℒ$¹ ⊆ $ℒ$², then for all B ∈ minloss ${\mathbb{B}}_{{\mathrm{ℒ}}^1}$ there exists a C ∈ minloss ${\mathbb{B}}_{{\mathrm{ℒ}}^2}$ such that$C_{\downharpoonright {\mathrm{ℒ}}^1}=B$.

Infinite-language invariance is motivated by the thought that simply adding new constant or predicate symbols to the language $ℒ$ should not change the inferences which are expressible in the original language $ℒ$. Note the following qualification: since each element of the domain is picked out by some member of $ℒ$, one can infer that in $ℒ$′ formed by adding constants to $ℒ$, there must be some constants which name the same individual.

We shall now proceed to show that the weighting functions which we focus on in this paper—the regular weighting functions—are infinite-language invariant.

Lemma 9. If ε, ε′ are non-empty and convex sets of the following form

$$\begin{array}{l}\epsilon \subseteq \{(x_1,\dots x_n)ϵ{\mathrm{ℝ}}^n:{\displaystyle \sum _{i=1}^n{x}_i=1\&x_i\ge 0}\}\\ {\epsilon }^{\prime }\subseteq \{(y_1,z_1,y_2,z_2,\dots ,y_n,z_n)ϵ{\mathrm{ℝ}}^{2n}:y_i,z_i\ge 0\&(y_1+z_1,\dots ,y_n+z_n)ϵ\epsilon \},\end{array}$$

then for

$$\begin{array}{l}\{(x_1^{†},\dots ,x_n^{†})\}=\arg \underset{(x_1,\dots ,x_n)ϵ{\epsilon }^{\prime }}{\sup }-{\displaystyle \sum _{i=1}^n{x}_i\log x_i}\\ \{(y_1^{†},z_1^{†},\dots ,y_n^{†},z_n^{†})\}=\arg \underset{(y_1,z_1,\dots ,y_n,z_n)ϵ{\epsilon }^{\prime }}{\sup }-{\displaystyle \sum _{i=1}^n{y}_i\log y_i+z_i\log z_i}\end{array}$$

it holds that$y_i^{†}=z_i^{†}=\frac{x_i^{†}}{2}$ for all 1 ≤ i ≤ n.

Proof. That the suprema are unique follows from the convexity of the sets ε, ε′ and the fact that $H_{\mathrm{\Omega }}^n,H_{\mathrm{\Omega }}^{2n}$ are strictly concave functions on ℙ_n, respectively, ℙ_2n.

Recall that $ℒ$^U is the language introduced in Lemma 2. $y^{†}=z_i^{†}=\frac{x_i^{†}}{2}$ is a direct consequence of $P_{\mathrm{\Omega }}^{†}$ equivocating beyond ${\mathrm{ℒ}}_k^U$ (Proposition 9). □

Theorem 7. If g is regular, then g is infinite-language invariant.

Proof. Let ${\mathbb{E}}_{\mathrm{ℒ}}$ be finitely generated by constraints expressible in $ℒ$_K. Let $ℒ$ ⊆ $ℒ$¹ ⊆ $ℒ$². By Theorem 6 we obtain minloss ${\mathbb{B}}_{{\mathrm{ℒ}}^1}={\mathrm{maxent}\mathbb{E}}_{{\mathrm{ℒ}}^1}=\{P_{\mathrm{\Omega }}^{{†}^1}\}$ and minloss ${\mathbb{B}}_{{\mathrm{ℒ}}^2}={\mathrm{maxent}\mathbb{E}}_{{\mathrm{ℒ}}^2}=\{P_{\mathrm{\Omega }}^{{†}^2}\}$, where $P_{\mathrm{\Omega }}^{{†}^1}$ and $P_{\mathrm{\Omega }}^{{†}^2}$ are the standard entropy limits on $ℒ$¹, respectively, $ℒ$².

Let K₂ ∈ ℕ be minimal such that ${\mathrm{ℒ}}_K\subseteq {\mathrm{ℒ}}_{K_2}^2$, i.e., the set of the first K₂ constant symbols of $ℒ$² contains the constant symbols {t₁, …, t_K} of $ℒ$. It suffices to show that for all n ≥ K₂ and all $\nu \in {\mathrm{\Omega }}_n^1$ it holds that $P_{\mathrm{\Omega }}^{{†}^1}(\nu )=P_{\mathrm{\Omega }}^{{†}^2}(\nu )$, where ${\mathrm{\Omega }}_n^1$ is the set of n-states of $ℒ$¹. Note that the constants in t₁, …, t_K are in ${\mathrm{ℒ}}_{K_2}^1$.

Since the standard entropy limits is finite-language invariant (Section 4.2.1) it follows for n ≥ K₂ that $P_{\mathrm{\Omega }}^{{†}^1}(\nu )=P_{\mathrm{\Omega }n}^{{†}^1}(\nu )$, where $\{P_{\mathrm{\Omega }n}^{{†}^1}\}=\arg {\sup }_{P\in {\mathbb{E}}_n^1}{S}_{\mathrm{\Omega }}^n(P)$, and $\{P_{\mathrm{\Omega }}^{{†}^2}\}(\nu )=\{P_{\mathrm{\Omega }n}^{{†}^2}\}(\nu )$, where $\{P_{\mathrm{\Omega }n}^{{†}^2}\}=\arg {\sup }_{P\in {\mathbb{E}}_n^2}{S}_{\mathrm{\Omega }}^n(P)$.

We now obtain from Lemma 9 and Proposition 5 that

$$P_{{\mathrm{\Omega }}_n}^{{†}^i}(\nu )=P_{\mathrm{\Omega }}^{†}({\omega }_{\nu })\frac{1}{2^{|\nu |-|{\omega }_{\nu }|}}$$

where ω_ν is the unique maximal state of $ℒ$ such that ν ⊨ ω_ν. Thus, $P_{\mathrm{\Omega }}^{{†}^1}(\nu )=P_{\mathrm{\Omega }}^{{†}^2}(\nu )$. □

So, neither adding new redundant names for individuals in the domain to $ℒ$ nor adding relation symbols which are not constrained by the agent’s evidence on $ℒ$ changes one’s rational beliefs in the sentences φ ∈ S$ℒ$.

Language invariance is an important desideratum for reasoning under uncertainty. We have seen that focussing on regular weighting functions ensures language invariance. We conjecture that, if one imposes the desiderata that g be atomic, inclusive, symmetric, refined and infinite-language invariant, then the standard entropy maximiser will be the belief function with the best loss profile. If this is the case then our results for regular weighting functions, which are strongly refined, are symptomatic of a more general phenomenon.

5. Handling Quantifiers

Thus far, we have shown that, on a language $ℒ$^∄ without quantifiers, if the evidence is finitely generated and the weighting function is regular, then the belief function that has the best lost profile is the probability function in $[{\mathbb{E}}_{\mathrm{ℒ}}]$ that maximises standard entropy. This provides a justification for all the norms of objective Bayesianism on a language without quantifiers.

As we shall see in Section 5.1, that the language is quantifier free was key here: on a language $ℒ$^∄ with quantifiers, the n-scores become infinite, which makes the comparison of loss profiles impossible. That the evidence is finitely generated is also key: we shall see in Section 6.1 that the minimax result need not hold true if the evidence is not finitely generated.

While the use of scoring rules cannot be readily adapted to a quantified language $ℒ$^∄, we shall see in Section 5.2 that we can nevertheless justify the norms of objective Bayesianism on $ℒ$^∄ if we extend our notion of loss profile and add two further desiderata motivated by the application of objective Bayesianism to inductive logic: that inferences should be language invariant, and that, ceteris paribus, universal hypotheses should be afforded substantial credence.

5.1. Limits to the Minimax Approach

Here we explain why the minimax analysis adopted in Section 4 cannot be applied to the case of a language with quantifier symbols. The problem is that n-score becomes infinite, making it impossible to compare the scores of different belief functions.

There are two ways in which n-score becomes infinite. The first is through a failure of super-regularity. A probability function is super-regular, if it gives every contingent sentence positive probability. Now, many probability functions that seem eminently rational are not super-regular. For example, if one has no evidence, ${\mathbb{E}}_{\mathrm{ℒ}}={\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$, then it is plausible that one is rationally entitled (even if not rationally compelled) to adopt the equivocator function P=, which gives each n-state the same probability, as one’s belief function. However, this probability function will give zero probability to a universally quantified sentence such as ∀xUx. More generally, if evidence is finitely generated then no inclusive, symmetric entropy maximiser will be super-regular:

Proposition 18. Let${\mathbb{E}}_{\mathrm{ℒ}}$ be finitely generated and let g be symmetric and inclusive. If the sequence${(P_n^{†})}_{n\in \mathrm{\mathbb{N}}}$ has a point of accumulation Q ∈ ℙ_$ℒ$, then Q is not super-regular.

Proof. Let U be a relation symbol in $ℒ$ of arity r, say. For all n ∈ ℕ let

$${\phi }^n:=\underset{{}_{\omega \models {\wedge }_{i=1}^{n}U{t}_i}^{\omega \in {\mathrm{\Omega }}_n}}{\vee }\omega ,$$

where t_i denotes the tuple of r repetitions of t_i.

If $P_K^{†}({\phi }^K)=0$, then by the open-mindedness of entropy maximisers $P_n^{†}({\phi }^K)=0$ for all n ≥ K. Thus, for all points of accumulation Q ∈ ℙ_$ℒ$ it holds that Q(φ^K) = 0. Hence, Q is not super-regular.

If $P_K^{†}({\phi }^K)>0$, then we apply Proposition 9 to find that for all l ≥ n

$$\begin{array}{l}{P}_l^{†}({\phi }^n)=P_l^{†}({\phi }^K)\frac{|{\mathrm{\Omega }}_K^U|}{|{\mathrm{\Omega }}_n^U|}\\ \le P_l^{†}({\phi }^K)2^{K-n}\\ \le 2^{K-n},\end{array}$$

Let Q be a point of accumulation of ${(P_n^{†})}_{n\in \mathrm{\mathbb{N}}}$ and let ${(P_n^{†})}_{n_j}$ be a subsequence which converges to Q. Since K is fixed we now find

$$\begin{array}{l}0\le Q(\forall xUx)\\ {}^{\underset{¯}{\underset{¯}{P3}}}\underset{j\to \mathrm{\infty }}{\lim }Q(\underset{i=1}{\overset{n_j}{\wedge }}U{t}_i)\\ =\underset{j\to \mathrm{\infty }}{\lim }\underset{m\to \mathrm{\infty }}{\lim }{P}_{n_m}^{†}(\underset{i=1}{\overset{n_j}{\wedge }}U{t}_i)\\ =\underset{j\to \mathrm{\infty }}{\lim }\underset{m\to \mathrm{\infty }}{\lim }{P}_{n_m}^{†}({\phi }^{n_j})\\ \le \underset{j\to \mathrm{\infty }}{\lim }{2}^{K-j}\\ =0.\end{array}$$

Q is not super-regular. □

Now, a failure of super-regularity is not normally problematic—it is simply a well accepted fact that probability theory forces probability 0 (respectively 1) on many sentences which might be true (respectively false). For example, the strong law of large numbers and the various zero-one laws force extreme probabilities. Moreover, the issue of super-regularity did not arise on $ℒ$^∄, where no contingent sentences are given probability 0 by the entropy maximisers considered above. However, a problem does emerge if we try to apply the scoring rule approach to $ℒ$^∄, where super-regularity becomes pertinent. If θ is possible yet is given zero belief by belief function B then the logarithmic loss, −log B(θ), is infinite if θ turns out to be true. Hence, as long as some epistemically possible physical probability function gives positive probability to θ, belief function B will have infinite score. When scores become infinite, they cannot be readily used to compare belief functions. It is clear, for example, that some non-super-regular belief functions will have better loss profiles than others, but this will not be apparent if we define loss profiles in terms of scores. This problem appears to limit the scope of scoring rules to languages without quantifiers.

One might suggest here that the fact that non-super-regular functions lead to infinite scores merely serves to show that one should adopt a super-regular function as one’s belief function. However, there are good grounds for questioning such a conclusion. In particular, consider again the case of a total absence of evidence. As mentioned above, imposing super-regularity rules out the equivocation function P= as a viable belief function. This means that any super-regular function must, in the total absence of evidence, force a skewed distribution on the n-states, for some n. Thus, one is forced to believe some states to a greater degree than others, despite the fact that one has no evidence to distinguish any such state from any other. So super-regularity leads to very counter-intuitive consequences and the infinite score problem suggests that the scoring rule approach breaks down on languages with quantifiers.

There is a second way in which the scores become infinite when quantifiers are admitted into the language. When one admits quantifiers into the language, one introduces the possibility of infinite partitions (Example 1) and it is natural, when defining a scoring rule on such a language, to consider scores on these infinite partitions. If a weighting function is inclusive then for any sentence $\theta \in S{\mathrm{ℒ}}^{\cancel{\exists }}$, some partition containing θ will be given positive weight. If it is refined, then any partition that refines this partition will be given positive weight, including any infinite partition which refines this partition. The problem is that, even in the total absence of evidence, every belief function has infinite worst-case expected loss over such a partition:

Proposition 19. If there exists a partition${\pi }_{\mathrm{\infty }}\in {\displaystyle \prod {}_{\mathrm{ℒ}}}$ consisting of infinitely many sentences such that g(π_∞) > 0, then for all$B\in {\mathbb{B}}_{\mathrm{ℒ}}$ it holds that

$$\underset{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}}{\sup }-{\displaystyle \sum _{\phi \in \pi }g({\pi }_{\mathrm{\infty }})P(\phi )\log B(\phi )=+\mathrm{\infty }.}$$

Proof. Let π_∞ = {φ₁, φ₂, … }. Let $B\in {\mathbb{B}}_{\mathrm{ℒ}}$ be arbitrary but fixed.

If there exists a φ ∈ π_∞ such that B(φ) = 0, then any $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ with P (φ) > 0 satisfies ${\displaystyle \sum {}_{\phi \in \pi }}-g({\pi }_{\mathrm{\infty }})P(\phi )\log B(\phi )=+\mathrm{\infty }$.

Now assume that B(φ_n) > 0 for all n ∈ ℕ.

Since $B\in {\mathbb{B}}_{\mathrm{ℒ}}$ it holds that ${\displaystyle \sum {}_{\phi \in {\pi }_{\mathrm{\infty }}}}B(\phi )\le 1$. Thus, there has to exists an infinite set ℕ_B ⊆ ℕ \ {1} such that n ∈ ℕ_B implies $0<B({\phi }_n)<\frac{1}{n}\le \frac{1}{2}$. Let $\{n_1^B,n_2^B,\dots \}$ be an enumeration of ℕ_B. Let $\{m_2^B,m_3^B,\dots \}$ be an enumeration of an infinite subset of ℕ_B such that $0<B({\phi }_{m_k^B})\le \frac{1}{e^{(k^2)}}<1$ and $m_k^B<m_{k+1}^B$ for all k ∈ ℕ \ {1}. Since the $n_k^B$ tend to infinity, such a sequence ${(m_k^B)}_{k\in \mathrm{\mathbb{N}}\backslash \{1\}}$ has to exist.

Recall that ${\displaystyle \sum {}_{n\in \mathrm{\mathbb{N}}}}\frac{1}{n^2}=\frac{{\pi }^2}{6}$. Let $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ be such that for k ≥ 2 it holds that

$$\begin{array}{l}P({\phi }_{m_k^B}):=\frac{6}{{\pi }^2}\cdot \frac{1}{k_2}\\ P({\phi }_1):=1-{\displaystyle \sum _{k=2}^{\mathrm{\infty }}P({\phi }_{m_k^B})}=\frac{6}{{\pi }^2}\\ P({\phi }_n):=0\mathrm{for}\mathrm{all}n\in \mathrm{\mathbb{N}}\backslash \{1,m_2^B,m_3^B,\dots \}.\end{array}$$

We now explain why such a probability function $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ exists.

The idea is to define a measure which assigns the set of term structures which are a model of ${\phi }_{m_k}^B$the value $\frac{6}{{\pi }^2}\frac{1}{k^2}$ and assigns value zero to all other term structures which do not model any of the ${\phi }_{m_k}^B$. The probability of an arbitrary sentence $\chi \in S\mathrm{ℒ}$ is then measure assigned to all term structures in which χ holds. One has to be careful of how to set up this measure. Fortunately, the recipe for doing so is well-known.

We follow [7] (pp. 164) and define a term structure $\mathrm{ℳ}$ of $\mathrm{ℒ}$ as a structure with domain {t_n : n ∈ ℕ} and each constant symbol t_n of $\mathrm{ℒ}$ is interpreted in $\mathrm{ℳ}$ as itself. We use T$\mathrm{ℒ}$ to denote the set of term structures of $\mathrm{ℒ}$.

Now let $\mathcal{P}(T\mathrm{ℒ})$ denote the power set of $T\mathrm{ℒ}$ and put

$$\begin{array}{c}T(\theta ):=\{\mathrm{ℳ}\in T\mathrm{ℒ}:\mathrm{ℳ}|=\theta \}\\ R:=\{T(\theta ):\theta \in S{\mathrm{ℒ}}^{\nexists }\}\subseteq \mathcal{P}(T\mathrm{ℒ}).\end{array}$$

For a quantified sentence θ = ∃xθ(x) let T(θ) := ∪_i∈ℕT(θ(t_i)), similarly for the universal quantifier ∀.

Now let μ* be any (finitely additive and normalised to one) outer measure on $\mathcal{P}(T\mathrm{ℒ})$ such that $\mu *({\phi }_{m_k}^B)=\frac{6}{{\pi }^2}\frac{1}{k^2}$. Particularly simple such outer measures μ* are measures which for all m_k assign a single particular term structure $\mathrm{ℳ}$ in which ${\phi }_{m_k}^B$ holds the value $\frac{6}{{\pi }^2}\frac{1}{k^2}$.

Next, define R^∞ to be the smallest subset of $\mathcal{P}(T\mathrm{ℒ})$ which contains R and is closed under complements and countable unions. We now define a countably additive measure μ^∞ on R^∞ as follows: μ^∞ : R^∞ → [0, 1] such that μ^∞(A) = μ*(A) for all A ∈ R^∞.

Letting P(θ) := μ^∞(T(θ)) defines a probability function as shown in [7] (pp. 168–171). Furthermore, by construction $\mu *({\phi }_i)=\frac{6}{i^2{\pi }^2}=P({\phi }_i)$.

Having demonstrated the existence of the required probability function P, we now show that, for this function P, B incurs an infinite loss. Intuitively, P(φ_n) can be obtained from the sequence ${(\frac{1}{k^2})}_{k\in \mathrm{\mathbb{N}}}$ by inserting zeros and normalising by multiplying with $\frac{6}{{\pi }^2}$. The idea behind this definition is to ensure that for all k ∈ ℕ there exists a unique n ∈ ℕ_B such that $P({\phi }_n)=\frac{6}{{\pi }^2}\cdot \frac{1}{k^2}$. Furthermore, for these n ∈ ℕ_B it holds that $B({\phi }_n)\le \frac{1}{e^{(k^2)}}$. For all other n > 1 we ensure that P(φ_n) vanishes; P(φ₁) is defined in such that Σ_φ∈π P(φ)=1 holds.

So, when P(φ_n) > 0 and $n\in \{m_2^B,m_3^B,\dots ,\}$ we have

$$\begin{array}{l}-P({\phi }_n)\log B({\phi }_n)\ge \frac{6}{{\pi }^2}\frac{1}{k^2}\log e^{(k^2)}\\ =\frac{6}{{\pi }^2}\frac{1}{k^2}{k}^2\log e\\ =\frac{6}{{\pi }^2}.\end{array}$$

Finally, we obtain

$$\begin{array}{l}-{\displaystyle \sum _{\phi \in \pi }g({\pi }_{\mathrm{\infty }})}P(\phi )\log B(\phi )\ge g({\pi }_{\mathrm{\infty }}){\displaystyle \sum _{m_2^B,m_3^B,\dots }\frac{6}{{\pi }^2}}\\ =+\mathrm{\infty }.\end{array}$$

In particular, even the super-regular belief functions have infinite score on any such partition, so one cannot say that any super-regular function has lower overall score than a non-super-regular function. This result, then, casts further doubt on the suggestion that it might be preferable to adopt a super-regular function as one’s belief function. Moreover, it clearly suggests that an attempt to extend the minimax approach, which is based on scoring rules, to languages with quantifiers will be fraught with difficulty.

5.2. The Probability Norm

We have argued that there is little scope for straightforwardly extending the minimax analysis to languages with quantifiers because of the problem that scores will quickly become infinite and thus incomparable. So we need another approach, if we are to show that the Probability axioms P1-P3, as well as the Calibration and Equivocation norms, are to apply to languages with quantifiers.

Our plan of attack is as follows. First, as noted in Section 4.5, language invariance is an important desideratum. In particular, one would not want one’s degrees of belief on the sentences of a quantifier-free language ${\mathrm{ℒ}}^{\nexists }$ to change if one were to introduce quantifiers into the language. That is, if evidence determines that one should adopt B₁ as one’s belief function on ${\mathrm{ℒ}}^{\nexists }$ and B₂ as one’s belief function on ${\mathrm{ℒ}}^{\exists }$, where both languages contain the same individuals and relation symbols, then one would want B₁ and B₂ to agree on quantifier-free sentences of $\mathrm{ℒ}$, i.e., one would want that B₁(θ) = B₂(θ) for each $\theta \in S{\mathrm{ℒ}}^{\nexists }$.

Thus far, we have argued that a belief function on ${\mathrm{ℒ}}^{\nexists }$, given finitely generated $\mathbb{E}$, ought to satisfy the axioms of probability P1 and P2 on ${\mathrm{ℒ}}^{\nexists }$, as well as the Calibration and Equivocation norms. Given the language invariance desideratum, this implies that the appropriate belief function on ${\mathrm{ℒ}}^{\exists }$, should, when restricted to quantifier-free sentences, satisfy P1, P2 and the Calibration and Equivocation norms. If we can show that the probability axioms P1-3 should also be satisfied on the language ${\mathrm{ℒ}}^{\exists }$ as a whole, then degrees of belief in the quantified sentences are uniquely determined by those on the quantifier-free sentences [7] (Theorem 11.2): there is no further role that Calibration or Equivocation can play on the quantified sentences. Thus it suffices to argue for the probability axioms on ${\mathrm{ℒ}}^{\exists }$. As usual, we restrict attention to evidence sets that are finitely generated in the sense of Definition 5, i.e., ${\mathbb{E}}_{\mathrm{ℒ}}$ generated by constraints involving sentences of some ${\mathrm{ℒ}}_K^{\nexists }$ and regular weighting functions g.

In Theorem 4 we showed that the default loss incurred by adopting belief function B when φ is true is such that L(φ, B) = − log B(φ), modulo some multiplicative constant. This penalises smaller degrees of belief more than larger degrees of belief. As discussed above, there is little scope for using this to measure the overall expected loss incurred by B on ${\mathrm{ℒ}}^{\exists }$, and so we cannot directly extend the notion of loss profile developed in Definition 21 to ${\mathrm{ℒ}}^{\exists }$. However, this default loss function does suggest the following constraint:

(*) Suppose that for all $\theta \in S{\mathrm{ℒ}}^{\exists }$, B(θ) ≥ B′(θ), and there is some $\phi \in S{\mathrm{ℒ}}^{\exists }$ such that B(φ) > B′(φ). Then B has a better loss profile than B′.

In other words, if the default loss incurred by B′ dominates that incurred by B then B has a better loss profile than B′. We can use (*) to extend our notion of loss profile: the two conditions in Definition 21 apply to quantifier-free sentences in ${\mathrm{ℒ}}^{\exists }$, and we add the further condition (*) to constrain the quantified sentences. We shall show that the addition of (*) goes some way towards demonstrating P1-3 on ${\mathrm{ℒ}}^{\exists }$, although we shall have to add a further desideratum in order to complete the derivation.

Definition 24 (Better loss profile on${\mathrm{ℒ}}^{\exists }$). B has a better loss profile on ${\mathrm{ℒ}}^{\exists }$ than B′ if and only if:

• B ≺ B′ (as defined in Definition 21), or
• B dominates B′ on${\mathrm{ℒ}}^{\exists }$ and there exists some$\phi \in S{\mathrm{ℒ}}^{\exists }$ such that B(φ) > B′(φ).

We write B ≺* B′ to denote that B has a better loss profile on${\mathrm{ℒ}}^{\exists }$ than B′. Clearly, ≺* is asymmetric. We will be interested in those belief functions on${\mathrm{ℒ}}^{\exists }$ that have the best loss profile on ${\mathrm{ℒ}}^{\exists }$, i.e., the minimal elements of ≺*, and define:

$$\mathrm{minloss}*{\mathbb{B}}_{\mathrm{ℒ}}:=\{B\in {\mathbb{B}}_{\mathrm{ℒ}}:thereison{B}^{\prime }\in {\mathbb{B}}_{\mathrm{ℒ}}suchthat{B}^{\prime }\prec *B\}.$$

(14)

Note that if B dominates B′ on ${\mathrm{ℒ}}^{\exists }$, then B ≺ B′ cannot hold. ≺ and ≺* are thus consistent.

Proposition 20. All B ∈ minloss* ${\mathbb{B}}_{\mathrm{ℒ}}$ agree with$P_{\mathrm{\Omega }}^{†}$ on${\mathrm{ℒ}}^{\nexists }$.

Proof. Since we assume that g is regular and that ${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated we can apply Theorem 6 to obtain that all all B ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$ agree with $P_{\mathrm{\Omega }}^{†}$ on ${\mathrm{ℒ}}^{\nexists }$.

The claim now follows, since B ≺ B′ implies B ≺* B′. □

Proposition 21. If minloss ${\mathbb{B}}_{\mathrm{ℒ}}=\varnothing$, then minloss* ${\mathbb{B}}_{\mathrm{ℒ}}=\varnothing$.

Proof. ≺ is asymmetric, irreflexive and transitive, Proposition 10; and thus free of cycles. Hence, for all fixed $B^{\prime }\in {\mathbb{B}}_{\mathrm{ℒ}}$ there exists some $B\in {\mathbb{B}}_{\mathrm{ℒ}}$ such that B ≺ B′. This implies B ≺* B′.

Hence, for all $B^{\prime }\in {\mathbb{B}}_{\mathrm{ℒ}}$ there exists some $B\in {\mathbb{B}}_{\mathrm{ℒ}}$ such that B ≺* B′. We obtain minloss* ${\mathbb{B}}_{\mathrm{ℒ}}=\varnothing$. □

We shall use $B_{†}\in {\mathbb{B}}_{\mathrm{ℒ}}$ to denote an arbitrary but fixed belief function in minloss* ${\mathbb{B}}_{\mathrm{ℒ}}$. A priori, it is not clear that such a function B_† exists.

The rest of this section does not depend on ${\mathbb{E}}_{\mathrm{ℒ}}$, the weighting function g nor the particular probability function the B ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$ agree with on ${\mathrm{ℒ}}^{\nexists }$. All that matters is that there exists some probability function $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ the B ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$ agree with on ${\mathrm{ℒ}}^{\nexists }$. As we know, this is the case if ${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated and g is regular.

Definition 25. A sentence$\phi \in S{\mathrm{ℒ}}^{\exists }$ is called contingent, if and only if φ and ¬φ are satisfiable.

Lemma 10. For all θ, $\phi \in S{\mathrm{ℒ}}^{\exists }$ such that θ |= φ it holds that B_†(φ) ≥ B_†(θ). In particular, B_†(ψ) = 0 for all contradictions$\psi \in S{\mathrm{ℒ}}^{\exists }$ and B_†(χ) = 1 for all tautologies$\chi \in S{\mathrm{ℒ}}^{\exists }$.

For θ, $\phi \in S{\mathrm{ℒ}}^{\exists }$ we have already seen that B_†(φ) ≥ B_†(θ), this followed from B_† satisfying P1 and P2 on ${\mathrm{ℒ}}^{\nexists }$.

Proof. Case 1. θ is a contradiction.

For a tautology $\tau \in S{\mathrm{ℒ}}^{\nexists }$, {τ, θ} is a partition. Since B_†(τ) = 1 and B_†(τ) + B_†(θ) ≤ 1 it follows that B_†(θ) = 0. Hence, B_†(φ) ≥ 0 = B_†(θ).

Case 2. θ is a tautology.

Let $\chi \in S{\mathrm{ℒ}}^{\exists }$ be a contradiction. We just proved that B_†(χ) = 0. The only constraints applying to B_†(θ) are of the form B_†(θ) + B_†(χ) ≤ 1 where χ is a contradiction and of the form B_†(θ) ≤ 1. Thus, the only meaningful constraint on B_†(θ) is B_†(θ) ≤ 1. By (*) we have B_†(θ) = 1.

Since θ implies φ, φ has to be a tautology, too. Hence, B_†(φ) = 1 = B_†(θ).

Case 3. θ is contingent.

If φ is a tautology, then B_†(φ) = 1 by the above and we are done.

Note that φ cannot be a contradiction since θ is satisfiable.

Assume from now on that φ is contingent.

Case 3A |= θ ↔ φ.

For all index sets I and all sentences ${\phi }_i\in S{\mathrm{ℒ}}^{\exists }$ the following are equivalent

• $\{\phi \}\cup {\displaystyle \cup {}_{i\in I}}\{{\phi }_i\}ϵ{\displaystyle \prod {}_{\mathrm{ℒ}}}$,
• $\{\theta \}\cup {\displaystyle \cup {}_{i\in I}}\{{\phi }_i\}ϵ{\displaystyle \prod {}_{\mathrm{ℒ}}}$

(*) implies that B_†(φ) = B_†(θ).

Case 3B θ, φ and φ ∧ ¬θ are contingent.

Let I be any countable index set and let ${\phi }_i\in S{\mathrm{ℒ}}^{\exists }$ for i ∈ I be contingent such that

$$\{\phi \}\cup {\displaystyle \underset{i\in I}{\cup }\{{\phi }_i\}ϵ{\displaystyle \prod {}_{\mathrm{ℒ}}}}.$$

Then by the consistency of θ and φ ∧ ¬θ

$$\{\theta \wedge \phi \}\cup \{\phi \wedge \neg \theta \}\cup {\displaystyle \underset{i\in I}{\cup }\{{\phi }_i\}ϵ{\displaystyle \prod {}_{\mathrm{ℒ}}}}.$$

And since θ |= φ

$$\{\theta \}\cup \{\phi \wedge \neg \theta \}\cup {\displaystyle \underset{i\in I}{\cup }\{{\phi }_i\}ϵ{\displaystyle \prod {}_{\mathrm{ℒ}}}}.$$

From normalisation (Definition 1) we now obtain

$$B_{†}(\phi )+{\displaystyle \sum _{i\in I}{B}_{†}({\phi }_i)}\le 1$$

(15)

$$B_{†}(\theta )+B_{†}(\phi \wedge \neg \theta )+{\displaystyle \sum _{i\in I}B({\phi }_i)}\le 1.$$

(16)

Note that the equations in (15) are the only constraints which constrain B_†(φ). In particular, B_†(φ) = B_†(θ) will not violate any constraint in (15).

The question arises whether B_†(ϕ) = B_†(θ) imposes any further constraints?

B_†(ϕ) only imposes constraints on the B_†(φ_i) for i ∈ I. Let i ∈ I be fixed and let J be an index set and ${({\psi }_j)}_{j\in J}\in S{\mathrm{ℒ}}^{\exists }$ be such that $\{{\phi }_i\}\cup \{\phi \}\cup {\displaystyle \cup {}_{j\in J}\{{\psi }_j\}}\in {\displaystyle \prod {}_{\mathrm{ℒ}}}$. Then $\{{\phi }_i\}\cup \{\theta \}\cup \{\phi \wedge \neg \theta \}\cup {\displaystyle \cup {}_{j\in J}\{{\psi }_j\}}\in {\displaystyle \prod {}_{\mathrm{ℒ}}}$. Thus, B_†(φ) = B_†(θ) does not impose any further constraint on B_†(φ_i) which is not already imposed by B_†(θ).

By (*) we now find B_†(θ) ≤ B_†(φ). □

Corollary 7. B_† respects logical equivalence on${\mathrm{ℒ}}^{\exists }$.

Proof. If φ, $\theta \in S{\mathrm{ℒ}}^{\exists }$ are logically equivalent, then B_†(φ) ≤ B_†(θ) ≤ B_†(φ) and thus B_†(φ) = B_†(θ). □

Corollary 8. For all$\exists x\theta (x)ϵS{\mathrm{ℒ}}^{\exists }$ it holds that

$$\underset{n\to \mathrm{\infty }}{\lim }{B}_{†}\left(\underset{i-1}{\overset{n}{{\displaystyle \vee }}}\theta (t_i)\right)\le B_{†}(\exists x\theta (x)).$$

Proof. First note that ${\vee }_{i=1}^n(\theta (t_i))$ implies ${\vee }_{i=1}^n(\theta (t_i))$. Thus, $B_{†}({\vee }_{i=1}^n(\theta (t_i)))$ is a (not necessarily strictly) increasing sequence in [0, 1] which has a limit. Finally, note that for all $n\in \mathrm{\mathbb{N}}{\vee }_{i=1}^n(\theta (t_i))$implies ∃xθ(x). Hence, B_†(∃xθ(x)) has to be greater or equal than the limit. □

Corollary 9 (Superadditivity of B_† on ${\mathrm{ℒ}}^{\exists }$). If |= ¬ (θ ∧ φ), then B_†(θ) + B_†(ϕ) ≤ B_†(θ ˅ φ).

Proof. If either θ or φ is a contradiction or a tautology, then the Corollary follows trivially.

If θ ˅ φ is a tautology, then the corollary follows trivially, too.

It remains to consider the case of contingent θ ˅ φ. By the above we may assume that θ and φ are contingent. Let I be any countable index set and let ${\phi }_i\in S{\mathrm{ℒ}}^{\exists }$ for i ∈ I be satisfiable such that

$$\{\theta \}\cup \{\phi \}\cup {\displaystyle \underset{i\in I}{\cup }\{{\phi }_i\}}\in {\prod }_{\mathrm{ℒ}}.$$

Then,

$$\{\theta \vee \phi \}\cup {\displaystyle \underset{i\in I}{\cup }\{{\phi }_i\}}\in {\prod }_{\mathrm{ℒ}}.$$

From normalisation (Definition 1) we now obtain

$$\begin{array}{r}{B}_{†}(\theta )+B_{†}(\phi )+{\displaystyle \sum _{i\in I}{B}_{†}}({\phi }_i)\le 1\\ B_{†}(\theta \vee \phi )+{\displaystyle \sum _{i\in I}{B}_{†}}({\phi }_i)\le 1.\end{array}$$

The same reasoning a in Lemma 10 about constraints now yields: B_†(θ) + B_†(φ) ≤ B_†(θ ˅ φ).

Lemma 11. For all$\theta \in S{\mathrm{ℒ}}^{\exists }$ it holds that B_†(θ) + B_†(¬θ) = 1.

In particular, this means that $B_{†}(\exists x\theta (x))+B_{†}(\forall x\neg \theta (x))=1\mathrm{for}\mathrm{all}\exists x\theta (x)ϵS{\mathrm{ℒ}}^{\exists }$.

Proof. If θ is not contingent, then the lemma holds trivially.

Now assume that θ is contingent and B_†(θ) + B_†(¬θ) < 1.

Case 1 There exist contingent ${(\phi )}_{i\in I},{(\psi )}_{j\in J}\in S{\mathrm{ℒ}}^{\exists }$ such that

$$\begin{array}{r}\{\theta \}\cup {\displaystyle \underset{i\in I}{\cup }\{{\phi }_i\}}\in {\prod }_{\mathrm{ℒ}}\\ \{\neg \theta \}\cup {\displaystyle \underset{j\in J}{\cup }\{{\psi }_j\}ϵ}{\prod }_{\mathrm{ℒ}}\end{array}$$

with

$$\begin{array}{r}{B}_{†}(\theta )+{\displaystyle \sum _{i\in I}{B}_{†}}({\phi }_i)=1\\ B_{†}(\neg \theta )+{\displaystyle \sum _{j\in J}{B}_{†}}({\psi }_j)=1.\end{array}$$

Note that ${\displaystyle \cup {}_{i\in I}}\{{\phi }_i\}\cup {\displaystyle \cup {}_{j\in J}}\{{\psi }_j\}ϵ{\prod }_{\mathrm{ℒ}}$ and thus ${\displaystyle \sum {}_{i\in I}}{B}_{†}({\phi }_i)+{\displaystyle \sum {}_{j\in J}}{B}_{†}({\psi }_j)\le 1$. Adding the above equations we now obtain

$$\begin{array}{l}2=B_{†}(\theta )+{\displaystyle \sum _{i\in I}{B}_{†}}({\phi }_i)+B_{†}(\neg \theta )+{\displaystyle \sum _{j\in J}{B}_{†}}({\psi }_j)\\ \le B_{†}(\theta )+B_{†}(\neg \theta )+1.\end{array}$$

B_†(θ) + B_†(¬θ) ≥ 1 follows. Contradiction.

Case 2 For all $\pi \in {\prod }_{\mathrm{ℒ}}$ with θ ∈ π and all ${\pi }^{\prime }\in {\prod }_{\mathrm{ℒ}}$ with $\neg \theta \in {{\pi }^{\prime }}_{\mathrm{ℒ}}$ it holds that ${\displaystyle \sum {}_{\phi \in \pi }}{B}_{†}(\phi )<1$ and ${\displaystyle \sum {}_{\psi \in {\pi }^{\prime }}{B}_{†}}(\psi )<1$.

Applying (*) we obtain a contradiction since B_†(θ) or B_†(¬θ) could have been set to a greater number.

Case 3 For all $\pi \in {\prod }_{\mathrm{ℒ}}$ with θ ∈ π it holds that ${\displaystyle \sum {}_{\psi \in \pi }}{B}_{†}(\psi )<1$ and there exists a partition ${\pi }^{\prime }\in {\prod }_{\mathrm{ℒ}}$ with $\neg \theta \in {{\pi }^{\prime }}_{\mathrm{ℒ}}$ such that ∑_φ∈π′ B_†(φ) = 1.

Let π′ comprise of contingent (φ_i)_i∈I and ¬θ. For $\pi \in {\prod }_{\mathrm{ℒ}}$ with θ ∈ π we have for all finite J ⊆ I that

$${\displaystyle \underset{j\in J}{\cup }\{{\phi }_j\}}\cup \{\theta \wedge \neg \underset{j\in J}{\vee }{\phi }_j\}\cup \{\psi \in \pi :\psi \ne \theta \}ϵ{\prod }_{\mathrm{ℒ}}.$$

In the same manner as in the proof of Lemma 10 it follows that B_†(θ) ≥ ∑_j∈J B_†(φ_j). Since this holds for all finite J ⊆ I and I can be at most countable, it follows that B_†(θ) ≥ ∑_i∈I B_†(φ_j).

From B_†(¬θ) + ∑_i∈I B_†(φ_j) = ∑_φ∈π′ B_†(φ) = 1 the required contradiction follows:

$$\begin{array}{l}{B}_{†}(\theta )+B_{†}(\neg \theta )\ge {\displaystyle \sum _{i\in I}{B}_{†}({\phi }_i)}+B_{†}(\neg \theta )\\ =1.\end{array}$$

□

(*) is not strong enough to uniquely determine constrain B_† on ${\mathrm{ℒ}}^{\exists }$. We invoke the following further desideratum to pin down B_†: ceteris paribus, prefer belief function B to belief function B′ if B gives greater degree of belief to some universally quantified sentence than does B′. One has to be a bit careful about how one formulates such a principle, in order to specify it in such a way that it can be applied consistently. One can appeal to the concept of prenex normal form in order to formulate this desideratum:

(∀*) Suppose that neither of B, B′ have a better loss profile on ${\mathrm{ℒ}}^{\exists }$ than the other. Furthermore, suppose there exists a minimal quantifier rank q such that the following hold: For all $\phi \in S{\mathrm{ℒ}}^{\exists }$ in prenex normal form with a quantifier rank of q−1 or less it holds that B(φ) = B(φ′) and for all universally quantified $\theta \in S{\mathrm{ℒ}}^{\exists }$ in prenex normal form of quantifier rank q it holds that B(θ) ≥ B′(θ) and the inequality is strict at least once. Then B is to be preferred to B′.

The motivation behind (∀*) is not in terms of loss. Rather, the motivation stems from the application to inductive logic (see Section 3.3). The use of probability in inductive logic has been roundly criticised for tending to give non-tautological universal laws probability zero, when such laws are widely—and seemingly rationally—believed in science and beyond; see, e.g., Popper [17] (Appendix *vii). Thus there seems good reason to prefer, ceteris paribus, those probability functions which give more credence to universal hypotheses. (There is a flip-side to (∀*). The more credence one gives to a universal statement ∀xθ(x), the less credence one must give to ∃x¬θ(x). One might motivate the latter policy by appeal to Okham’s Razor, which demands scepticism with respect to the existence of entities—particularly new kinds of entity.)

This leaves us with some desiderata that stem from considerations to do with loss, namely the criteria that make up Definition 21—appealing to dominance of loss, dominance of expected loss, and worst-case expected loss—and some desiderata that stem from the application to inductive logic, namely language invariance and (∀*). These desiderata taken together are enough to justify the norms of objective Bayesianism on ${\mathrm{ℒ}}^{\exists }$, as we shall proceed to show in the remainder of this section.

We shall see first that (∀*) is responsible for ensuring that the degree of belief B(∀xθ(x)), which is already constrained to $[0,{\inf }_{n\in \mathrm{\mathbb{N}}}{\wedge }_{i=1}^{n}B(\theta (t_i))]$, is equal to the upper bound. On the other hand, B(∃xθ(x)) comes out to be ${\sup }_{n\in \mathrm{\mathbb{N}}}{\wedge }_{i=1}^{n}B(\theta (t_i))$. An arbitrary belief function B_† ∈ minloss* ${\mathbb{B}}_{\mathrm{ℒ}}$ which is also optimal according to (∀*) will be denoted by $B_{†}^{\forall }$.

Proposition 22. For all universally quantified sentences$\forall x\theta (x)ϵ{\mathrm{ℒ}}^{\exists }$ it holds that$B_{†}^{\forall }(\forall x\theta (x))={\lim }_{n\to \mathrm{\infty }}{B}_{†}^{\forall }({\wedge }_{i=1}^n\theta (t_i))$.Proof. First note that $\forall x\theta (x)|={\wedge }_{i=1}^n\theta (t_i)$ for all n ∈ ℕ and we thus obtain from Lemma 10 that $B_{†}^{\forall }(\forall x\theta (x))\le {\lim }_{n\to \mathrm{\infty }}{B}_{†}^{\forall }({\wedge }_{i=1}^n\theta (t_i))$.

We now prove by an argument on quantifier ranks that

$$B_{†}^{\forall }(\forall x\theta (x))=\underset{n\to \mathrm{\infty }}{\lim }{B}_{†}^{\forall }(\underset{i=1}{\overset{n}{\wedge }}\theta (t_i)).$$

Assume for contradiction that there exists a minimal quantifier rank q ≥ 1 and a sentence ∀xψ(x) in prenex normal form of quantifier rank q such that $B_{†}^{\forall }(\forall x\psi (x))<{\lim }_{n\to \mathrm{\infty }}{B}_{†}^{\forall }({\wedge }_{i=1}^n\psi (t_i))$.

We now define a function B′ which will be preferred to $B_{†}^{\forall }$ which contradicts our standing assumption that no function is preferred to $B_{†}^{\forall }$. Let $B^{\prime }(\chi ):=B_{†}^{\forall }(\chi )$ for all sentences $\chi \in S{\mathrm{ℒ}}^{\exists }$ which are in prenex normal form and have a quantifier rank of q − 1 or less. In particular, $B_{†}^{\forall }$ and B′ agree on ${\mathrm{ℒ}}^{\nexists }$.

For all $\phi (x)ϵ{\mathrm{ℒ}}^{\exists }$ in prenex normal form of quantifier rank q − 1 we let

$$B^{\prime }(\forall x\phi (x)):=\underset{n\to \mathrm{\infty }}{\lim }{B}_{†}^{\forall }(\underset{i=1}{\overset{n}{\wedge }}\phi (t_i))$$

and

$$B^{\prime }(\exists x\neg \phi (x)):=\underset{n\to \mathrm{\infty }}{\lim }{B}_{†}^{\forall }(\underset{i=1}{\overset{n}{\vee }}\neg \phi (t_i)).$$

Now arbitrarily extend B′ to a function in ${\mathbb{B}}_{\mathrm{ℒ}}$.

Note that $B^{\prime }(\forall x\psi (x))>B_{†}^{\forall }(\forall x\psi (x))$ and $B^{\prime }(\exists x\neg \psi (x))<B_{†}^{\forall }(\exists x\neg \psi (x))$. So, (*) does not discriminate between $B_{†}^{\forall }$ and B′. Hence, $B_{†}^{\forall }$and B′ are equally preferable according to ≺*.

$B_{†}^{\forall }$ and B′ agree on all sentences in prenex normal form of quantifier rank q−1. Since $B_{†}^{\forall }(\forall x\phi (x))\le {\lim }_{n\to \mathrm{\infty }}{B}_{†}^{\forall }({\wedge }_{i=1}^n\phi (t_i))$ has to hold for all $\phi (x)ϵ{\mathrm{ℒ}}^{\exists }$ it follows that for φ(x) in prenex normal form of quantifier rank q − 1 that $B_{†}^{\forall }(\forall x\phi (x))\le B^{\prime }(\forall x\phi (x))$ and for ∀xφ(x) = ψ the inequality is sharp. (∀*) now implies that B′ is preferred to $B_{†}^{\forall }$.

Finally, every sentence of the form ∀xθ(x) is logically equivalent to a universally quantified sentence φ = ∀xφ(x) in prenex normal. Note that θ(t) is logically equivalent to φ(t) for all constants t. Hence,

$$\begin{array}{l}{B}_{†}^{\forall }(\forall x\theta (x))=B_{†}^{\forall }(\forall x\phi (x))\\ =\underset{n\to \mathrm{\infty }}{\lim }{B}_{†}^{\forall }(\underset{n=1}{\overset{n}{\wedge }}\phi (t_i))\\ =\underset{n\to \mathrm{\infty }}{\lim }{B}_{†}^{\forall }(\underset{n=1}{\overset{n}{\wedge }}\theta (t_i)).\end{array}$$

□

Proposition 23.$B_{†}^{\forall }$ satisfies the axiom P3.

Proof. Applying Lemma 11, Proposition 22 and applying Lemma 11 a second time we find

$$\begin{array}{l}{B}_{†}^{\forall }(\exists x\theta (x))=1-B_{†}^{\forall }(\forall x\neg \theta (x))\\ =1-\underset{n\to \mathrm{\infty }}{\lim }{B}_{†}^{\forall }(\underset{i=1}{\overset{n}{\wedge }}\neg \theta (t_i))\\ =1-\underset{n\to \mathrm{\infty }}{\lim }\left(1-B_{†}^{\forall }(\underset{i=1}{\overset{n}{\vee }}\theta (t_i))\right)\\ =\underset{n\to \mathrm{\infty }}{\lim }{B}_{†}^{\forall }(\underset{i=1}{\overset{n}{\vee }}\theta (t_i)).\end{array}$$

□

The following might be of interest outside the context of this paper since it generalises Gaifman’s Theorem, [5] (Theorem 1).

Proposition 24. If$f:S{\mathrm{ℒ}}^{\exists }\to [0,1]$ satisfies

• f(θ) = 1 for all tautologies$\theta \in S{\mathrm{ℒ}}^{\nexists }-[P1on{\mathrm{ℒ}}^{\nexists }]$,
• for all mutually exclusive θ, $\phi \in S{\mathrm{ℒ}}^{\nexists }$ it holds that$f(\theta \vee \phi )=f(\theta )+f(\phi )-[P2on{\mathrm{ℒ}}^{\nexists }]$,
• $f(\exists x\theta (x))={\sup }_{m}P({\vee }_{i=1}^m\theta (t_i))$ for all$\exists x\theta (x)ϵS{\mathrm{ℒ}}^{\exists }$ and – [P3]
• f respects logical equivalence on${\mathrm{ℒ}}^{\exists }$ − [P4],

then f is a probability function, i.e., $f\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$.

Clearly, P1 on ${\mathrm{ℒ}}^{\nexists }$ and P4 jointly imply P1.

Proof. First note that f agrees with some probability function on the quantifier free sentences of $\mathrm{ℒ}$. By Gaifman’s Theorem, this probability function is unique on ${\mathrm{ℒ}}^{\exists }$; it shall be denoted by P_f.

We now show that f = P_f. We need to show that for all $\phi \in S{\mathrm{ℒ}}^{\exists }$ that f(φ) = P_f(φ).

First, write φ in prenex normal form, φ_pre. Note that f(φ) = f(φ_pre).

Next, we do a proof by induction on the quantifier-block rank of φ_pre to show that f(φ_pre) = P_f(φ_pre). The quantifier-block rank of φ_pre is the number of alternating quantifier blocks in φ_pre

Base case φ_pre is of quantifier block rank zero, i.e., φ_pre does not contain quantifiers. Then

$$\begin{array}{l}f(\phi )=f({\phi }_{pre})\\ =P_f({\phi }_{pre})\\ =P_f(\phi ),\end{array}$$

where the second equation holds since f and P_f agree on all sentences of ${\mathrm{ℒ}}^{\nexists }$. The first and the last equation hold since f and P_f respect logical equivalence on ${\mathrm{ℒ}}^{\nexists }$. This fact will be used without further mention.

Inductive step φ_pre is of quantifier block rank q ≥ 1.

Let us first suppose that ${\phi }_{pre}=\exists \overline{x}\chi (\overline{x})$ For q ≥ 2 the first symbol of χ is a universal quantifier, ∀, for q = 1, the first symbol of χ is a relation symbol, a negation symbol or an opening bracket. We find for q = 1

$$\begin{array}{l}f(\phi )=f({\phi }_{pre})\\ =f(\exists \overline{x}\chi (\overline{x}))\\ \stackrel{p3}{=}\underset{n_1\to \mathrm{\infty }}{{\displaystyle \lim }}\mathrm{...}\underset{n_k\to \mathrm{\infty }}{{\displaystyle \lim }}f\left(\underset{i_1=1}{\overset{n_1}{{\displaystyle \vee }}}\mathrm{...}\underset{i_k=1}{\overset{n_k}{{\displaystyle \vee }}}\chi (t_{i_1},\mathrm{...},t_{i_k})\right)\\ =\underset{n_1\to \mathrm{\infty }}{{\displaystyle \lim }}\mathrm{...}\underset{n_k\to \mathrm{\infty }}{{\displaystyle \lim }}{P}_f\left(\underset{i_1=1}{\overset{n_1}{{\displaystyle \vee }}}\mathrm{...}\underset{i_k=1}{\overset{n_k}{{\displaystyle \vee }}}\chi (t_{i_1},\mathrm{...},t_{i_k})\right)\\ \stackrel{p3}{=}{P}_f(\exists \overline{x}\chi (\overline{x}))\\ =P_f({\phi }_{pre})\\ =P_f(\phi ),\end{array}$$

where we may substitute P_f for f since χ is quantifier-free and we can thus apply the induction hypothesis.

For q ≥ 2 ${\phi }_{pre}=\exists {\overline{x}}_1\forall {\overline{x}}_2\mathrm{...}Q{\overline{x}}_q\chi \left({\overline{x}}_1,{\overline{x}}_2,\dots \right)$, where Q = ∃ for odd q and Q = ∀ for even q.

First, here is an example of two logically equivalent sentences:

$$\models \left(\underset{i=1}{\overset{2}{\vee }}\forall x_1\exists x_{2}U{x}_1{x}_2{t}_i\right)\leftrightarrow \left(\forall y_1^1\forall y_2^1\exists y_1^2\exists y_2^2\underset{i=1}{\overset{2}{\vee }}U{y}_i^1{y}_i^2{t}_i\right).$$

Note that the quantifier block rank on of the sentence on the right of “↔” is two. The quantifier block rank has been kept low at the price of larger blocks of quantifiers. Since we are giving a proof by induction on the quantifier block rank, we do not have to worry about paying this price. To denote the larger blocks we will use $\overline{y}$. In general, the greater the number of variables and on the left of an ${\overline{x}}_i$, the greater the number of variables in ${\overline{y}}_i$.

Now let us compute

$$\begin{array}{l}f(\phi )=f({\phi }_{pre})\\ =f(\exists {\overline{x}}_1\forall {\overline{x}}_2\mathrm{...}Q{\overline{x}}_q\chi ({\overline{x}}_1,{\overline{x}}_2,\mathrm{...}{\overline{x}}_q))\\ \stackrel{p3}{=}\underset{n_1\to \mathrm{\infty }}{{\displaystyle \lim }}\mathrm{...}\underset{n_k\to \mathrm{\infty }}{{\displaystyle \lim }}f\left(\underset{i_1=1}{\overset{n_1}{{\displaystyle \vee }}}\mathrm{...}\underset{i_k=1}{\overset{n_k}{{\displaystyle \vee }}}\forall {\overline{x}}_2\mathrm{...}Q{\overline{x}}_q\chi (t_{i_1},\mathrm{...},t_{i_k},{\overline{x}}_2,\mathrm{...}{\overline{x}}_q)\right)\\ =\underset{n_1\to \mathrm{\infty }}{{\displaystyle \lim }}\mathrm{...}\underset{n_k\to \mathrm{\infty }}{{\displaystyle \lim }}f\left(\forall {\overline{y}}_2\mathrm{...}Q{\overline{y}}_q\underset{i_1=1}{\overset{n_1}{{\displaystyle \vee }}}\mathrm{...}\underset{i_k=1}{\overset{n_k}{{\displaystyle \vee }}}\chi (t_{i_1},\mathrm{...},t_{i_k},{\overline{y}}_2,\mathrm{...},{\overline{y}}_q)\right)\\ \stackrel{IH}{=}\underset{n_1\to \mathrm{\infty }}{{\displaystyle \lim }}\mathrm{...}\underset{n_k\to \mathrm{\infty }}{{\displaystyle \lim }}{P}_f\left(\forall {\overline{y}}_2\mathrm{...}Q{\overline{y}}_q\underset{i_1=1}{\overset{n_1}{{\displaystyle \vee }}}\mathrm{...}\underset{i_k=1}{\overset{n_k}{{\displaystyle \vee }}}\chi (t_{i_1},\mathrm{...},t_{i_k},{\overline{y}}_2,\mathrm{...},{\overline{y}}_q)\right)\\ =\underset{n_1\to \mathrm{\infty }}{{\displaystyle \lim }}\mathrm{...}\underset{n_k\to \mathrm{\infty }}{{\displaystyle \lim }}{P}_f\left(\underset{i_1=1}{\overset{n_1}{{\displaystyle \vee }}}\mathrm{...}\underset{i_k=1}{\overset{n_k}{{\displaystyle \vee }}}\forall {\overline{x}}_2\mathrm{...}Q{\overline{x}}_q\chi (t_{i_1},\mathrm{...},t_{i_k},{\overline{x}}_2,\mathrm{...},{\overline{x}}_q)\right)\\ \stackrel{P3}{=}{P}_f(\exists {\overline{x}}_1\forall {\overline{x}}_2\mathrm{...}Q{\overline{x}}_q\chi ({\overline{x}}_1,{\overline{x}}_2,\mathrm{...}{\overline{x}}_q))\\ =P_f({\phi }_{pre})\\ =P_f(\phi ).\end{array}$$

“I H” indicates that we used the induction hypothesis on a sentence of quantifier rank q − 1.

The case of ${\phi }_{pre}$ = ∀xχ(x) is analogous, simply replace the disjunctions by conjunctions.

Theorem 8. If${\mathbb{E}}_{\mathrm{ℒ}}$ is finitely generated and g is regular, then

$$\{B_{†}^{\forall }\}={\mathrm{maxent}\mathbb{E}}_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}^{{}^{†}}\}.$$

Proof. By Proposition 24 we only need to convince ourselves that $B_{†}^{\forall }$ satisfies P1 on ${\mathrm{ℒ}}^{\nexists }$, P2 on ${\mathrm{ℒ}}^{\nexists }$, P3 and P4 in order to conclude that $B_{†}^{\forall }\in {\mathcal{P}}_L$. Note that we have done so in Theorem 6, Proposition 23 and Corollary 7. So all $B_{†}^{\forall }$ are probability functions.

All $B_{†}^{\forall }$ agree on ${\mathrm{ℒ}}^{\nexists }$ with $P_{\mathrm{\Omega }}^{{}^{†}}$. Two different probability functions have to disagree on a quantifier-free sentence (Gaifman’s theorem). Hence, $B_{†}^{\forall }$ is a unique and equal to $P_{\mathrm{\Omega }}^{{}^{†}}$.

We should point out that (∀*) was only used in Proposition 23. We showed that (*) alone is enough to force that $B_{†}$satisfies P1, P2 on ${\mathrm{ℒ}}^{\nexists }$, $B_{†}(\exists x\theta \left(x\right))\ge {\lim }_{n\to \mathrm{\infty }}{B}_{†}({{\displaystyle \vee }}_{i=1}^n\theta (t_i))$ and P4.

In sum, then, by adding invoking two new considerations, (*) and (∀*), one can show that the Probability norm must hold on a predicate language with quantifiers. Since the Calibration and Equivocation norms are already forced on the quantifier-free sentences, and probabilities on these quantifier-free sentences determine those of the quantified sentences, all the norms of objective Bayesianism hold on ${\mathrm{ℒ}}^{\nexists }$, assuming that the weighting function is regular and the evidence is finitely generated.

6. More Complex Evidence

The question arises as to which functions have an optimal loss profile when ${\mathbb{E}}_L$ is not finitely generated. In Section 6.2 we shall present a tractable case and show that in that example the function with maximal standard entropy has the best loss profile. First, in Section 6.1, we shall see that not all examples admit of such an analysis. In particular, we shall analyse an example in some depth in which $\{P^{†}\}={\mathrm{maxent}\mathbb{E}}_{\mathrm{ℒ}}\mathrm{but}{P}^{†}6\notin {\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}$. Thus, when evidence is not finitely generated, the optimal loss profile may not be achievable by maximising entropy.

6.1. When Losses Cannot Be Minimised

We shall now develop an example in which the minimax theorem fails: $P_{\mathrm{\Omega }}^{{}^{†}}\notin {\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}},$ as we shall see in Proposition 27. However, the entropy identity, ${\mathcal{P}}^{†}=\{P_{\mathrm{\Omega }}{}^{†}\}={\mathrm{maxent}\mathbb{E}}_{\mathrm{ℒ}}$, does hold (Proposition 25 and Proposition 26). The connection with optimal loss fails to obtain since minloss ${\mathbb{B}}_{\mathrm{ℒ}}=\varnothing$ (Proposition 30). Thus, there is no belief function with an optimal loss profile in this sort of example. Nevertheless, certain equivocal functions ${\overline{P}}_N{}^{†}$ derived from the maximal entropy function come arbitrarily close to having the best loss profile (Proposition 29 and Proposition 31). So, while there is no unique function with the best loss profile, the functions ${\overline{P}}_N{}^{†}$ have a very good loss profile.

In the following discussion we shall focus on the most simple possible language, $\mathrm{ℒ}={\mathrm{ℒ}}^U$, which contains only one relation symbol, U, which is unary. We focus on this simple language since the minimax results already fail here and considering more expressive languages does not lead to new insights while creating more notational issues. As a technical convenience, we extend the notion of a loss profile to arbitrary functions $f:S\mathrm{ℒ}\to \left[0,1\right]$, not merely normalised belief functions.

The example that we shall consider is generated by the following evidence:

$$E=\{\neg U_1{t}_i\to \neg U_1{t}_1:i=1,2,\dots \}.$$

Let ${{\displaystyle \omega }}_k^n\in {\mathrm{\Omega }}_n$ be the k-th n-state of $\mathrm{ℒ}={\mathrm{ℒ}}^U$, i.e., ${{\displaystyle \omega }}_1^n:={{\displaystyle \wedge }}_{l=1}^n\neg U{t}_1,{{\displaystyle \omega }}_2^n:={{\displaystyle \wedge }}_{l=1}^{n-1}\neg U{t}_1\wedge U{t}_{\mathrm{n}},\mathrm{...},{{\displaystyle \omega }}_{n^2}^n:={{\displaystyle \wedge }}_{l=1}^{n}U{t}_1$. The set of calibrated probability functions can be characterized in various ways:

$$\begin{array}{l}{\mathbb{E}}_L=\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P\left(\neg U_1{t}_i\to \neg U_1{t}_1\right)=1,i=1,2,\dots \}\\ =\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P\left({\omega }^n{}^{+1}1\right)=P\left({\omega }_1^n\right)\text{for all}n\ge 1\}\\ =\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P\left({\omega }_i^n\right)=0\mathrm{for}2\le i\le 2^{n-}{}^1,n=1,2,\mathrm{...}\}\\ =\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P\left({\omega }_2^n\right)=0\text{for all}n\ge 2\}\\ =\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P(\neg U{t}_1\wedge U{t}_n)=0\text{for all}n\ge 2\}\\ =\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P({\omega }_1^{{{}^n}^{+1}}|{\omega }_1^n)=1\text{for all}n\in \mathrm{\mathbb{N}}\}\\ =\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P({\omega }_2^{{{}^n}^{+1}}|{\omega }_1^n)=0\text{for all}n\in \mathrm{\mathbb{N}}\}\\ =\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P(\forall x(U{t}_1\vee \neg Ux))=1\}\\ =\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P(\exists x(\neg U{t}_1\wedge Ux))=0\}\end{array}$$

The last two characterisations employ quantifiers; adding quantifiers to the language enables a finite representation of what is essentially an infinitely generated evidence set. Hence in Definition 5, we specified that an evidence set is finitely generated just if it generated by quantifier-free sentences of some finite sublanguage.

We now begin our analysis of this example:

Proposition 25. If g = g_Ω or if g is symmetric and inclusive, then${\mathrm{\mathbb{P}}}^{{}^{†}}=\{P_{\mathrm{\Omega }}^{{}^{†}}\}$ and$P_{\mathrm{\Omega }}^{{}^{†}}$ is not open-minded.

Proof. For all $n\in \mathrm{\mathbb{N}}$

$${\mathbb{E}}_n=\{P\in {\mathrm{\mathbb{P}}}_{{{\displaystyle \mathrm{ℒ}}}_n^{\nexists }}:p({{\displaystyle \omega }}_i^n)=0\text{for all}2\le \mathrm{i}\le 2^{\mathrm{n}-1}\}.$$

Then, by Landes and Williamson [4] (Corollary 6, p. 3574) for symmetric and inclusive g

$$P_n^{{}^{†}}({{\displaystyle \omega }}_1^n)=P_n^{{}^{†}}({{\displaystyle \omega }}_i^n)=\frac{1}{2^{n-1}+1}{\text{for all}2}^{\mathrm{n}-1}+1\le \mathrm{i}\le 2^{\mathrm{n}}$$

and so for all $n\in \mathrm{\mathbb{N}}$and all 1 ≤ i ≤ 2ⁿ⁻¹

$$\begin{array}{l}\underset{n\to \mathrm{\infty }}{\lim }{P}_n{}^{†}\left({\omega }_1^n\right)=\underset{n\to \mathrm{\infty }}{\lim }{P}_n{}^{†}\left({\omega }_1^1\right)\\ =\underset{n\to \mathrm{\infty }}{\lim }\frac{1}{2^{n-1}+1}\\ =0.\end{array}$$

For all $n\in \mathrm{\mathbb{N}}$ and i ∈ {1, 2ⁿ⁻¹+1,…,2ⁿ}

$$P^{†}({{\displaystyle \omega }}_1^n)=\frac{1}{2^{n-1}}.$$

The result for g = g_Ω follows in the same way as above. □

We shall note for later reference that for all n ≥ 2

$${{\displaystyle H}}_{\mathrm{\Omega }}^n(P_n{}^{†})=-\log \frac{1}{2^{n-1}+1}>-\log \frac{1}{2^{n-1}}={{\displaystyle H}}_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}{}^{†}).$$

Proposition 26. If g = g_Ω or if g is regular, then

$${\mathrm{maxent}\mathbb{E}}_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}{}^{†}\}.$$

Proof. First note that $[{\mathbb{E}}_{\mathrm{ℒ}}]={\mathbb{E}}_{\mathrm{ℒ}}$.

We shall show that for all $Q\in {\mathbb{E}}_{\mathrm{ℒ}}\backslash \{P_{\mathrm{\Omega }}{}^{†}\}$there exists an $N\in \mathrm{\mathbb{N}}$such that for all n ≥ N we have ${{\displaystyle H}}_{\mathrm{\Omega }}^n(P_n{}^{†})>{{\displaystyle H}}_{\mathrm{\Omega }}^n(Q)$ and ${{\displaystyle H}}_g^n(P_{\mathrm{\Omega }}{}^{†})>{{\displaystyle H}}_g^n(Q)$.

Since $Q\ne P_{\mathrm{\Omega }}{}^{†}$ there exists a minimal $k\in \mathrm{\mathbb{N}}$ and a k-state ν ∈ Ω_k such that Q(ν) > P_Ω^†(ν) ≥ 0.

Case 1$\nu ={\omega }_1^k$.

To simplify notation let α := P_k^†(ν) = P_k^†() $\alpha :=P_k{}^{†}\left(\nu \right)=P_k{}^{†}({\omega }_1^n)>0\text{for all}\mathrm{n}\ge 1$ Let us now define a function $Q^{\prime }\in {\mathbb{E}}_{\mathrm{ℒ}}\backslash \{P_{\mathrm{\Omega }}^{†}\}$. Note that since we want $Q^{\prime }$ to be a member of ${\mathbb{E}}_{\mathrm{ℒ}}$ we need to let $Q^{\prime }({\omega }_1^n):=Q^{\prime }({\omega }_1^1)\text{for all n}\in \mathrm{\mathbb{N}}$. Now let for all $\mathrm{n}\in \mathrm{\mathbb{N}}$

$$\begin{array}{l}{Q}^{\prime }({\omega }_1^n):\alpha >0\\ Q^{\prime }({\omega }_i^n):=0\mathrm{for}2\le i\le 2^{n-1}\\ Q^{\prime }({\omega }_i^n):=\frac{1-\alpha }{2^{n-1}}\mathrm{for}{2}^{n-1}+1\le i\le 2^n\end{array}$$

The restriction operator ${}_{\downharpoonright n}$ applied to some belief function B continuous to refer to the restriction of B to ${\mathrm{ℒ}}_n^{\nexists }$, rather than to the restriction to ${\mathrm{ℒ}}_n$.

Note that for all n ≥ 1

$$\{{Q^{\prime }}_{{}_{\downharpoonright n}}\}=\arg \underset{\underset{P({\omega }_1^n)=\alpha }{p\in E_n}}{\sup }{{\displaystyle H}}_g^n(P)$$

since entropy maximisers assign n-states the same degree of belief whenever possible [4] (Corollary 7, p. 3577). Thus, $H_g^n\left(Q^{\prime }\right)\ge H_g^n\left(Q\right)\text{for all}n\in \mathrm{\mathbb{N}}.\text{Also},H_{\mathrm{\Omega }}^n\left(Q^{\prime }\right)\ge H_{\mathrm{\Omega }}^n\left(Q\right)\text{for all}n\in \mathrm{\mathbb{N}}$.

Let us compute for n ≥ k

$$\begin{array}{l}{H}_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}{}^{†})-H_{\mathrm{\Omega }}^n(Q^{\prime })=-\log (\frac{1}{2^{n-1}})-[-\alpha \log (\alpha )-(1-\alpha )\log (\frac{1-\alpha }{2^{n-1}})]\\ =\log (2^{n-1})+\alpha \log (\alpha )+(1-\alpha )(\log (1-\alpha )-\log (2^{n-1}))\\ =\log (2^{n-1})-(1-\alpha )\log (2^{n-1})+\alpha \log (\alpha )+(1-\alpha )\log (1-\alpha )\\ =\alpha (n-1)\log (2)+\alpha \log (\alpha )+(1-\alpha )\log (1-\alpha ).\end{array}$$

It follows that for all large enough n ∈ $\mathrm{\mathbb{N}}$ that $H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}{}^{†})>H_{\mathrm{\Omega }}^n(Q^{\prime })\ge H_{\mathrm{\Omega }}^n(Q)$.

For regular g we now find

$$\begin{array}{l}{H}_g^n(P_{\mathrm{\Omega }}{}^{†})-H_g^n(Q^{\prime })=g({\pi }^n).[\alpha (n-1)\log (2)+\alpha \log (\alpha )+(1-\alpha )(\log (1-\alpha )]\\ -{\displaystyle \sum _{\pi \in {\prod }_n}g(\pi )}{\displaystyle \sum _{F\in \pi }°P_{\mathrm{\Omega }}{}^{†}(F)\log (°P_{\mathrm{\Omega }}{}^{†}(F))-°Q^{\prime }(F)\log }(°Q^{\prime }(F)).\end{array}$$

So, as long as ${\displaystyle \sum \pi \in {\prod }_n\backslash \{{\pi }^n\}}g(\pi )$ goes to zero quickly enough it follows that $H_g^n(P_{\mathrm{\Omega }}{}^{†})>H_g^n(Q^{\prime })\ge H_g^n(Q)$ for large enough n. Corollary 6 shows that this is indeed the case for regular g.

Case 2$\nu \in \{{\omega }_2^k,\dots ,{\omega }_{2^{{{}_{k-}}_1}}^k\}$ Since Q is assumed to be calibrated, $Q\in {\mathbb{E}}_{\mathrm{ℒ}}$, this case cannot occur. Case 3$\nu \in \{{\omega }_{2^{{{}_{k-}}_1}+1}^k,\dots ,{\omega }_{2^{{}_k}}^k\}$.

Case 3A$Q\{{\omega }_1^k\}=0$.

Then $Q\{{\omega }_1^1\}=0.$ But for all n ∈ ℕ

$$\arg \underset{\underset{P({\omega }_1^1=0)}{P\in E_n}}{\sup }{H}_{\mathrm{\Omega }}^n(P)=\{P_{\mathrm{\Omega }\downharpoonright n}^{†}\}=\arg \underset{\underset{P({\omega }_1^1=0)}{P\in E_n}}{\sup }{H}_g^n(P)$$

Since Q ≠ P_Ω^† it follows that there exists some N ∈ ℕ such that $Q_{\downharpoonright n}\ne P_{\mathrm{\Omega }\downharpoonright n}^{†}\text{for all}n\ge N$. But then $H_g^n\left(P_{\mathrm{\Omega }}^{†}\right)>H_g^n\left(Q\right)\mathrm{and}{H}_{\mathrm{\Omega }}^n\left(P_{\mathrm{\Omega }}^{†}\right)>H_{\mathrm{\Omega }}^n\left(Q\right)\text{for all}n\ge N$.

Case B$Q\{{\omega }_1^k\}>0$.

Then $Q({\omega }_1^k)>0=P_{\mathrm{\Omega }}^{†}({\omega }_1^k)$. Proceed as in Case 1. □

Proposition 27. If g = g_Ω or if g is regular, then$P_{\mathrm{\Omega }}^{†}\notin {\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}$.

Proof. We here show that there exists an $R\in {\mathbb{E}}_{\mathrm{ℒ}}$such that for all n ∈ ℕ it holds that $S_g^n\left(R,P^{†}\right)=S_{\mathrm{\Omega }}^n\left(R,P^{†}\right)=\mathrm{\infty }$ and that there exists an open-minded $Q\in {\mathbb{E}}_{\mathrm{ℒ}}$such that for all n ∈ ℕ we have ${\sup }_{P\in E_{\mathrm{ℒ}}}{S}_{\mathrm{\Omega }}^n(P,Q)<\mathrm{\infty }$.

Note that the probability function $R\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$with $R\left({\omega }_1^n\right):=1$. Then $S_g^n\left(R,P_{\mathrm{\Omega }}^{†}\right)=S_{\mathrm{\Omega }}^n\left(R,P_{\mathrm{\Omega }}^{†}\right)=\mathrm{\infty }\text{for all}n\in \mathrm{\mathbb{N}}$.

We shall now construct an open-minded $Q\in {\mathbb{E}}_{\mathrm{ℒ}}$ as advertised. For all n ∈ ℕ let

$$\begin{array}{l}Q({\omega }_1^n):=\frac{1}{2}\\ Q({\omega }_i^n):=0\text{for all}2\le i\le 2^{n-1}\\ Q({\omega }_i^n):=\frac{1}{2^n}\text{for all}{2}^{n-1}+1\le i\le 2^n.\end{array}$$

Thus, Q is open-minded and hence ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_{\mathrm{\Omega }}^n\left(P,Q\right)\le {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n\left(P,Q\right)<+\mathrm{\infty }$ for all n∈ ℕ. □

Note that Condition 1 of Definition 21 is solely responsible for the fact that $P_{\mathrm{\Omega }}^{†}\notin {\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}$. Condition 2 has played no role here.

So far, we have established that $P^{†}=P_{\mathrm{\Omega }}^{†}$ does not have the best loss profile. The question arises whether there exists a belief function $B\in {\mathbb{B}}_{\mathrm{ℒ}}$ which is a minimal element of ≺, i.e., $B\in {\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}$.

Proposition 28. If g = g_Ω, then

$${\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}=\varnothing =\mathrm{minloss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}={\mathrm{minloss}\mathbb{E}}_{\mathrm{ℒ}}$$

Initially, one might suspect that ${\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}=\varnothing$ would be somehow due to the fact that the $S_{\mathrm{\Omega }}^n$do not take beliefs in all sentences into account. This is not the case. As we will see, $\mathrm{minloss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}=\varnothing ={\mathrm{minloss}\mathbb{E}}_{\mathrm{ℒ}}$ holds. That is, even when restricting attention to probability functions, whose values on the n-states completely determine degrees of beliefs in all other sentences, we cannot find a function with an optimal loss profile.

Proof. Suppose for contradiction that $Q\in \mathrm{minloss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\backslash \{P_{\mathrm{\Omega }}^{†}\}$.

If Q is not open-minded, then there exists an N ∈ ℕ, an F ⊆ Ω_N and an $\mathcal{P}\in {\mathbb{E}}_{\mathrm{ℒ}}$ such that °P (F ) > 0 and °Q(F ) = 0. But then there has to exists some ω ∈ Ω_N with ω ∈ F such that P (ω) > 0 = Q(ω) since Q and P are probability functions. Thus, for all n ≥ N there exists some ν ∈ Ω_n such that ν = ω with P (ν) > 0 = Q(ν). But then $S_{\mathrm{\Omega }}^n\left(P,Q\right)=+\mathrm{\infty }$for all n ≥ N.

In the proof of Proposition 27 we constructed an open-minded function Q⁺ ∈ E_$ℒ$. For Q⁺ we have for all n that $su{p}_{p\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_{\mathrm{\Omega }}^n(P,Q^{+})<+\mathrm{\infty }$. So, any $Q\in \mathrm{minloss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ has to be open-minded.

Case 1$Q\in \mathrm{minloss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\backslash {\mathbb{E}}_{\mathrm{ℒ}}$and Q ∉ E_$ℒ$

Since $Q\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\backslash {\mathbb{E}}_{\mathrm{ℒ}}$ there has to exist a minimal k ≥ 2 such that $Q({\omega }_2^k)>0$.

We next define a probability function $Q^{\prime }\in {\mathbb{E}}_{\mathrm{ℒ}}$ with the following construction for all n ≥ 2

$$\begin{array}{l}{Q}^{\prime }({\omega }_i^l):=Q({\omega }_i^l)\text{for all}1\le l\le k-1\text{and all}i\\ Q^{\prime }({\omega }_1^n):=Q({\omega }_1^k)\text{for all}n\in \mathrm{\mathbb{N}}\\ Q^{\prime }({\omega }_1^n):=0\text{for all n}\ge k\text{and all}2\le i\le 2^{n-1}\\ Q^{\prime }({\omega }_i^n):=Q({\omega }_i^n)\text{for all}{2}^{n-1}+1\le i\le 2^n.\end{array}$$

It follows that for all n ≥ k and all $\omega \in {\mathrm{\Omega }}_n\backslash \{{\omega }_2^n,\dots ,{\omega }_{2^{n-1}}^n\}$ and all $P\in {\mathbb{E}}_n$ such that P (ω) > 0 it holds that. $Q\left(\omega \right)\le Q^{\prime }\left(\omega \right)$ For all large enough n ∈ N we then find

$$\begin{array}{l}\underset{p\in E_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n\left(P,Q\right)\ge -\log \underset{2^{n-1}+1\le i\le 2^n}{\min }\{Q\left(\omega \right)\}\\ =-\log \underset{2^{n-1}+1\le i\le 2^n}{\min }\{Q^{\prime }\left(\omega \right)\}\\ =\underset{p\in E_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n\left(P,Q^{\prime }\right)\end{array}$$

Hence, there has to exists a $Q^{\prime }\in {\mathbb{E}}_{\mathrm{ℒ}}\cap \mathrm{minloss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\mathrm{with}{Q}^{\prime }\ne P_{\mathrm{\Omega }}^{†}$.

Case 2 Q$Q\in \mathrm{minloss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\mathrm{and}Q\in {\mathbb{E}}_{\mathrm{ℒ}}\{P_{\mathrm{\Omega }}^{†}\}$.

Thus, $0<Q\left({\omega }_1^1\right)=Q({\omega }_1^n)\text{for all n}\ge 2.$ Let N ≥ 3 be such that $Q({\omega }_1^N)>\min \{Q({\omega }_{2^{N-1}+1}^N),\mathrm{...},Q({\omega }_{2^N}^N)\}$ For n ≥ N let

$${\mathrm{\Omega }}_n^{-}:=\arg \min \{Q({\omega }_{2^{n-1}+1}^n),\mathrm{...},Q({\omega }_{2^n}^n)\}\subset {\mathrm{\Omega }}_n$$

We now find for all fixed n ≥ N that

$$\underset{p\in E_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q)=-\log Q({\omega }_{-}^n)\text{for all}{\omega }_{-}^n\in {\mathrm{\Omega }}_n^{-}.$$

We shall now define a function $\mathbb{R}\in {\mathbb{E}}_{\mathrm{ℒ}}\backslash \{P_{\mathrm{\Omega }}^{†}\}$ by letting for all n ≥ 2:

$$\begin{array}{l}R({\omega }_1^n):=\frac{Q({\omega }_1^n)}{2}=\frac{Q({\omega }_1^1)}{2}\\ R({\omega }_i^n):=0\text{for all}2\le i\le 2^{n-1}\\ R({\omega }_i^n):=Q({\omega }_i^n)+\frac{Q({\omega }_1^1)}{2}\frac{2}{|{\mathrm{\Omega }}_n|}>Q({\omega }_i^n)\text{for all}{2}^{n-1}+1\le i\le 2^n\end{array}$$

That is, $R=\frac{Q+P_{\mathrm{\Omega }}^{†}}{2}$.

For large enough M ∈ ℕ it holds for all n ≥ M that

$$R({\omega }_1^n)>\min \{R({\omega }_{2^{n-1}+1}^n),\mathrm{...},R({\omega }_{2^n}^n)\}$$

Furthermore, for all n ≥ max{M, N} it holds that

$$\arg \min \{Q({\omega }_{2^{n-1}+1}^n),\dots ,Q({\omega }_{2^n}^n)\}=\arg \min \{R\left({\omega }_{2^{n-1}+1}^n\right),\dots ,R({\omega }_{2^n}^n)\}$$

and hence for all large enough fixed n ∈ ℕ and all ${\omega }_{-}^n\in {\mathrm{\Omega }}_n^{-}$

$$\underset{P\in E_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,R)=-\log R({\omega }_{-}^n)<\log Q({\omega }_{-}^n)=\underset{P\in E_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q).$$

Thus, R has a better loss profile than Q. Hence, $Q\notin \mathrm{minloss}{\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\mathrm{and}Q\notin {\mathrm{minloss}\mathbb{E}}_{\mathrm{ℒ}}$.

Finally, let us consider loss profiles for $B\in {\mathbb{B}}_{\mathrm{ℒ}}\backslash {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}.$.

Case 3$B\in {\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}\mathrm{and}B\notin {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$..

For all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$, the expression $S_{\mathrm{\Omega }}^n\left(P,B\right)$only depends on the degrees of belief B assigns to sentences which represent an n-state. So, the degree of belief in a sentence φ ∈ S$ℒ$ which does not n-represent an n-state are ignored by $S_{\mathrm{\Omega }}^n\left(P,B\right)$ for all n and all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$. If B agrees with some probability function $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ on all sentences of S$ℒ$^∄ which n-represent an n-state, then B and P are equally preferable according to ≺. As we saw above, for all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ there exists some $Q\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ with Q ≺ P. Thus, B cannot be a minimal element of ≺.

We can hence assume that for all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ there exists some sentence $\phi \in S{\mathrm{ℒ}}_n^{\nexists }$ which n-represents an n-state such that B(φ) 6= P(φ). Since no $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ is dominated, it follows that B(ϕ) < P(φ).

First define a function B₀ as follows:

$$\begin{array}{l}{B}_0(\phi ):=\underset{\rho \omega =\phi }{\underset{\rho \in \varrho n}{\inf }}B\left(\rho \omega \right),\text{if such an}n\in \mathrm{\mathbb{N}}\text{and such a}\rho \in {\varrho }_n\mathrm{exist},\\ B_0(\phi ):=0\mathrm{otherwish}.\end{array}$$

B₀, which does not agree with any probability function on ${\mathrm{ℒ}}^{\nexists }$ has been constructed in such a way that B and B₀ are equally preferred according to ≺.

Next define a function B⁺ by first letting for all fixed N ∈ ℕ

$$B^{+}(\phi ):=\underset{n\ge N}{\sup }{\displaystyle \sum _{\begin{array}{c}v\in {\mathrm{\Omega }}_n\\ v=\omega \end{array}}{B}_0(v)}$$

for all sentences $\phi \in S{\mathrm{ℒ}}_N^{\exists }$ which are logically equivalent to an N-state. Put B⁺(ψ) := 0 for all other $\psi \in S{\mathrm{ℒ}}^{\exists }$.

Since B⁺ dominates B₀ the loss profile of B⁺ cannot be worse than that of B₀. Furthermore, note that for all N ∈ ℕ, all ω ∈ Ω_N and all n > N it holds that

$$B^{+}(\omega )\ge {\displaystyle \sum _{\begin{array}{c}v\in {\mathrm{\Omega }}_n\\ v|=\omega \end{array}}{B}^{+}(v)}.$$

Let $\alpha :={\lim }_{n\to \mathrm{\infty }}{\displaystyle \sum {}_{\omega \in {\mathrm{\Omega }}_n}}{B}^{+}(\omega )$. For α = 0 it follows by the usual reasoning that B⁺ cannot have an ideal loss profile. This leads to a contradiction in the usual way.

For 1 ≥ α > 0 define a function B^∞ by first letting for all sentences $\phi \in S{\mathrm{ℒ}}^{\exists }$ which are logically equivalent to some n-state ω

$$B^{\mathrm{\infty }}(\phi ):=\frac{1}{\alpha }\underset{n\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\begin{array}{c}v\in {\mathrm{\Omega }}_n\\ v|=\phi \end{array}}{B}^{+}}(v).$$

For all other sentences $\phi \in S{\mathrm{ℒ}}^{\exists }$ let B^∞(φ) := 0.

Observe that for all k ∈ ℕ and all ω ∈ Ω_k

$$\begin{array}{l}{B}^{\mathrm{\infty }}(\omega )=\frac{1}{\alpha }\underset{n\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\begin{array}{c}v\in {\mathrm{\Omega }}_n\\ v|=\omega \end{array}}{B}^{+}}(v)\\ =\frac{1}{\alpha }\underset{n\to \mathrm{\infty }}{\lim }{\displaystyle \sum _{\begin{array}{c}\lambda \in {\mathrm{\Omega }}_{k+1}\\ \lambda |=\omega \end{array}}{\displaystyle \sum _{\begin{array}{c}v\in {\mathrm{\Omega }}_n\\ v|=\lambda \end{array}}B+(v)}}\\ ={\displaystyle \sum _{\begin{array}{c}\lambda \in {\mathrm{\Omega }}_{k+1}\\ \lambda |=\omega \end{array}}{B}^{\mathrm{\infty }}(\lambda )}.\end{array}$$

Finally, we note that B^∞ agrees with some $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ on all sentences in $S{\mathrm{ℒ}}^{\exists }$ which represent a state. Then B cannot have a better loss profile than P. As we saw in Case1 and Case2, for all $P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ there exists a $Q\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ which has a strictly better loss profile than P. This contradicts B ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$. □

Denote by ${\overline{P}}_N^{†}$ the unique probability function in ${\mathbb{E}}_{\mathrm{ℒ}}$ satisfying for all n ∈ ℕ

$$\begin{array}{l}{\overline{P}}_N^{†}({\omega }_1^n)=P_N^{†}({\omega }_1^n)=P_N^{†}({\omega }_1^1)=\frac{1}{2^{N-1}+1}\\ {\overline{P}}_N^{†}({\omega }_i^n)=0\mathrm{for}\mathrm{all}2\le i\le 2^{n-1}\\ {\overline{P}}_N^{†}({\omega }_i^n)=\left(1-\frac{1}{2^{N-1}+1}\right)\cdot \frac{2}{|{\mathrm{\Omega }}_n|}=\frac{1}{\frac{|{\mathrm{\Omega }}_N|}{2}+1}\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}\mathrm{for}\mathrm{all}{2}^{n-1}+1\le i\le 2^n.\end{array}$$

That is, ${\overline{P}}_N^{†}$ agrees with ${\overline{P}}_N^{†}$ on ${\mathrm{ℒ}}_N$ and equivocates beyond ${\mathrm{ℒ}}_N$ as much as possible while satisfying ${\overline{P}}_N^{†}\in {\mathbb{E}}_{\mathrm{ℒ}}$Proposition 29. For all ϵ > 0 there exists an N ∈ $\mathrm{\mathbb{N}}$ such that for all n ≥ N

$$\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,{\overline{P}}_N^{†})-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,P_n^{†})\le ϵ.$$

Proof. For all large enough N ∈ $\mathrm{\mathbb{N}}$ and even larger n ∈ $\mathrm{\mathbb{N}}$ we find

$$\begin{array}{l}0\le \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,{\overline{P}}_N^{†})-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,P_n^{†})\\ =-\log \left(\frac{\frac{|{\mathrm{\Omega }}_N|}{2}}{\frac{|{\mathrm{\Omega }}_N|}{2}+1}\frac{2}{|{\mathrm{\Omega }}_n|}\right)+\log \left(\frac{1}{\frac{2^n}{2}+1}\right)\\ =-\log \left(\frac{2^{N-1}}{2^{N-1}+1}\right)+\log \left(\frac{2^n}{2}\right)+\log (\frac{1}{2^{n-1}+1})\\ =-\log \left(\frac{2^{N-1}}{2^{N-1}+1}\right)+\log \left(\frac{2^{n-1}}{2^{n-1}+1}\right).\end{array}$$

For ϵ > 0 let N > 2 be such that $0<-\log \frac{2^{N-1}}{2^{N-1}+1}<ϵ$. Then for all n ≥ N it holds that $0>\log \frac{2^{n-1}}{2^{n-1}+1}>\log \frac{2^{N-1}}{2^{N-1}+1}$. For n ≥ N large enough we now obtain

$$\begin{array}{l}0\le \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,{\overline{P}}_N^{†})-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,P_n^{†})\\ =-\log \left(\frac{2^{N-1}}{2^{N-1}+1}\right)+\log \left(\frac{2^{N-1}}{2^{N-1}+1}\right)\\ <ϵ.\end{array}$$

□

Having considered loss for $\mathrm{g}={\mathrm{g}}_{\mathrm{\Omega }}$ we now investigate loss for regular $\mathrm{g}$.

Proposition 30. If$\mathrm{g}$ is regular, then minloss ${\mathbb{B}}_{\mathrm{ℒ}}=\varnothing$.

Proof. We will show that ≺ has no minimal element. Suppose for contradiction that B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ is such a minimal element.

Define a function $B^{\prime }:S\mathrm{ℒ}\to [0,1]$ by

$$\begin{array}{l}B\prime (\phi ):=0\text{for all}\phi \in \text{for which there exists an}n\in \mathrm{with}\underset{i=2}{\overset{2^{n-1}}{\vee }}{\omega }_i^n=\phi \\ B\prime \left(\psi \right):=B\left(\psi \right)\mathrm{else}.\end{array}$$

B′ and B are equally preferable according to ≺ since P (φ) = 0 for all P ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ and all such φ.

For all φ ∈ $S{\mathrm{ℒ}}^{\nexists }$ let n_φ be the minimal n such that φ ∈ $S{\mathrm{ℒ}}_{n_{\phi }}^{\nexists }$. Now define a function B^inf by first letting

$$B^{\inf }\left(\phi \right)=\underset{\begin{array}{l}\psi \in S{\mathrm{ℒ}}_{n_{\phi }}^{\nexists }\\ \models \phi \leftrightarrow \psi \end{array}}{\inf }{B}^{\prime }\left(\psi \right).$$

Put B^inf(φ) := B′(φ) for all other φ ∈ $S{\mathrm{ℒ}}^{\exists }$. For all φ ∈ $S\mathrm{ℒ}$ it holds that B^inf(φ) ≤ B(φ). Furthermore, B^inf is equally preferable to B′ according to ≺. We now consider cases to show that there is a function with a strictly better loss profile than B^inf, which contradicts our assumption that B ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$.

Case A There exists some N ∈ $\mathrm{\mathbb{N}}$ such that for all n ≥ N, B^inf and $P_{\mathrm{\Omega }}^{†}$ agree on all n-states. Since $B\ne P_{\mathrm{\Omega }}^{†}$ it holds that $B^{\inf }\ne P_{\mathrm{\Omega }}^{†}$ and hence $B_{\frac{1}{2}}:=\frac{B^{\inf }+P_{\mathrm{\Omega }}^{†}}{2}\ne P_{\mathrm{\Omega }}^{†}$. Thus, for all n ≥ N$B_{\frac{1}{2}}$and $P_{\mathrm{\Omega }}^{†}$ agree on all n-states. But then for all n ≥ N all F ⊆ Ω_n and all ρ ∈ ϱ_n$B^{\inf }(\rho F)\le B_{\frac{1}{2}}(\rho F)$. Hence, for all P ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ it holds that $S_{\mathrm{g}}^n(P,B_{\frac{1}{2}})\le S_{\mathrm{g}}^n(P,B^{\inf })$.

From the above we have that for all n ≥ N there exists an F ⊆ Ω_n such that $F\backslash \{{\omega }_2^N,\dots ,{\omega }_{2^{N-1}}^N\}=\varnothing$ and such that $B^{\inf }(\rho F)<B_{\frac{1}{2}}(\rho F)$ for some ρ. Thus, there exists some P ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ with °P(F) > 0. Then $S_{\mathrm{g}}^n(P,B_{\frac{1}{2}})<S_{\mathrm{g}}^n(P,B^{\inf })$ for this P ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ and all n ≥ N.

Thus, $B_{\frac{1}{2}}\prec B^{\inf }$ by Condition 2 of Definition 21.

Case B There exist infinitely many n ∈ $\mathrm{\mathbb{N}}$ where B^inf and $P_{\mathrm{\Omega }}^{†}$ agree on all n-states and infinitely many n ∈ $\mathrm{\mathbb{N}}$ many where they do not agree on all n-states.

Since $P_{\mathrm{\Omega }}^{†}$ is a probability function it follows that for all n ∈ $\mathrm{\mathbb{N}}$, all F ⊆ Ω_n and all ρ ∈ ϱ_n$B^{\inf }(\rho F)\le P_{\mathrm{\Omega }}^{†}(\rho F)$ has to hold. Now proceed as in Case A.

Case C The number of n ∈ $\mathrm{\mathbb{N}}$ for which B^inf and $P_{\mathrm{\Omega }}^{†}$ agree on all n-states is finite (possibly zero).

Case C1 There exists an infinite set J ⊆ $\mathrm{\mathbb{N}}$, J = {j₁, j₂, … }, such that lim_i−→∞${\displaystyle \sum {}_{\omega \in {\mathrm{\Omega }}_{j_i}}{B}^{\inf }(\omega )}=1$.

If $P_{\mathrm{\Omega }}^{†}$ dominates B^inf, we are done.

If $P_{\mathrm{\Omega }}^{†}$ does not dominate B^inf, then define a function B₁ ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ by letting for all n ∈ $\mathrm{\mathbb{N}}$ and all F ⊆ Ω_n

$$°B_1(F):=\underset{i\to \mathrm{\infty }}{\lim }\sum _{\begin{array}{l}\omega \in {\mathrm{\Omega }}_{j_i}\\ \omega \in F\end{array}}{B}^{\inf }(\omega )$$

and requiring that B₁ satisfies logical equivalence on L^∄. For all φ ∈ $S{\mathrm{ℒ}}^{\exists }\backslash S{\mathrm{ℒ}}^{\nexists }$ use Gaifman’s condition to ensure that B₁ is a probability function.

Since we assumed that $P_{\mathrm{\Omega }}^{†}$ does not dominate B^inf$B_1\ne P_{\mathrm{\Omega }}^{†}$ holds. Furthermore, B₁ dominates B^inf.So, the loss profile of B₁ ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ is at least equally good as that of B.

We complete this proof by showing that ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ ∩ minloss ${\mathbb{B}}_{\mathrm{ℒ}}=\varnothing$.

Now suppose for contradiction that there exists a function Q ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ ∩ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$ such that $Q({\omega }_2^n)>0$ for some n ≥ 2, i.e., Q ∉ ${\mathbb{E}}_{\mathrm{ℒ}}$. It needs to hold that $Q({\omega }_1^n)>0$ for all n ∈ $\mathrm{\mathbb{N}}$ (open-mindedness).

Let k ≥ 2 be minimal such that $Q({\omega }_2^k)>0$. Now define a function R ∈ ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ by letting for all n > k

$$\begin{array}{l}R({\omega }_i^k):=\frac{Q({\omega }_i^k)+P_{\mathrm{\Omega }}^{†}({\omega }_i^k)}{2}\mathrm{for}\mathrm{all}1\le i\le 2^k\\ R({\omega }_i^n):=R({\omega }_1^k)=\frac{Q({\omega }_1^k)}{2}=\frac{Q({\omega }_1^k)+P_{\mathrm{\Omega }}^{†}({\omega }_1^k)}{2}\mathrm{for}\mathrm{all}n>k\\ R({\omega }_{2^{n-k+1}}^n):=\frac{Q({\omega }_2^k)+P_{\mathrm{\Omega }}^{†}({\omega }_2^k)}{2}=\frac{Q({\omega }_2^k)}{2}>0\\ R({\omega }_i^n):=\frac{Q(v)+P_{\mathrm{\Omega }}^{†}(v)}{2}\mathrm{for}\mathrm{all}{2}^{n-1}+1\le i\le 2^n\mathrm{where}v\in {\mathrm{\Omega }}_k\mathrm{with}{\omega }_i^n\models v\\ R({\omega }_i^n):=0\mathrm{otherwise}.\end{array}$$

That is, R is the arithmetic mean of Q and $P_{\mathrm{\Omega }}^{†}$ on ${\mathrm{ℒ}}_k$. Beyond ${\mathrm{ℒ}}_k$, R equivocates under the k-states which imply Ut₁. For such n-states $R({\omega }_i^n)=\frac{Q(v)+\frac{1}{2^{n-1}}}{2}$ holds. Beyond ${\mathrm{ℒ}}_k$, there are only two n-states which imply ¬Ut₁ which are assigned non-zero probability, $w_1^n$ and $w_{2^{n-k+1}}^n$.

We now show that R has a strictly better loss profile than Q what contradicts Q ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$.

Let $v_k^{-}$ ∈ arg ${\min }_{\omega \in \{{\omega }_{2^{k-1}+1^{,\dots ,}}^k{\omega }_{2^k}^k\}}$. Trivially, $0<Q(v_k^{-})<\frac{1}{2^{k-1}}$. Next note that for all n ≥ k which are large enough it holds that

$$\underset{\omega \in \{{\omega }_1^n,{\omega }_{2^{n-1}+1}^n,\cdots ,{\omega }_{2^n}^n\}}{\min }R(\omega )=\frac{\frac{1}{2^{k-1}}+Q(v_k^{-})}{2}\cdot \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_n|}$$

and that

$$\underset{\omega \in \{{\omega }_{2^{n-1}+1}^n,\cdots ,{\omega }_{2^n}^n\}}{\min }Q(\omega )Q(v_k^{-})\cdot \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_n|}.$$

We now find for all large enough n > k that

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,Q)-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,R)\ge g({\pi }^n)\log \left(Q(v_k^{-})\cdot \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_n|}\right)-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,R)\\ \ge g({\pi }^n)\left(-\log \left(Q(v_k^{-})\cdot \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_n|}\right)-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,R)\right)\\ -\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }-{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}g(\pi ){\displaystyle \sum _{F\in \pi }°P(F)\log °R(F)}}.\end{array}$$

Whenever °P (F) > 0 with F ⊆ Ω_n, then °R(F) is bounded from below by $\frac{1}{2^n}$. Hence, the last term in the above sum converges to zero, since g is regular.

We now obtain the contradiction as follows: there exists some ϵ > 0 such that for all large enough n ≥ k it holds that

$$\begin{array}{l}-\log \left(Q(v_k^{-})\cdot \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_n|}\right)-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,R)\\ =-\log \left(Q(v_k^{-})\cdot \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_n|}\right)+\log \left(\frac{\frac{1}{2^{k-1}}+Q(v_k^{-})}{2}\cdot \frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_n|}\right)\\ =\log \left(\frac{\frac{1}{2^{k-1}}+Q(v_k^{-})}{2}\right)-\log Q(v_k^{-})\\ \ge ϵ.\end{array}$$

We have thus shown that if ${\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}$ ∩ minloss ${\mathbb{B}}_{\mathrm{ℒ}}\ne \varnothing$, then there exists some Q ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ ∩ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$.

Case C1A$Q(w_1^1)=0$. Then Q has infinite worst-case expected loss for all n ∈ $\mathrm{\mathbb{N}}$ and we are done.

Case C1B$Q({\omega }_1^1)>0$.

By open-mindedness, $Q({\omega }_1^1)<1$ has to hold.

For all n ∈ $\mathrm{\mathbb{N}}$ let ${\omega }_{-}^n$ ∈ arg ${\min }_{\omega \in \{{\omega }_{2^{n-1}+1^{,\dots ,}}^n{\omega }_{2^n}^n\}}Q(\omega )$ From Q ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ we now obtain that for all large enough n there exists a probability function R ∈ arg ${\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}$$S_{\mathrm{\Omega }}^n(P,Q)$ such that $R({\omega }_{-}^n)=1$.

Next, define a probability function Q′ ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ where $Q^{\prime }({\omega }_1^n):=Q^{\prime }({\omega }_1^1):=Q^{\prime }({\omega }_1^1)$ and Q′ equivocates over Ut₁, $Q^{\prime }({\omega }_i^n):=Q({\omega }_2^1)\frac{|{\mathrm{\Omega }}_1|}{|{\mathrm{\Omega }}_n|}$ for all n ∈ $\mathrm{\mathbb{N}}$ and for all 2ⁿ⁻¹ + 1 ≤ i ≤ 2ⁿ. Assume for contradiction that Q ≠ Q′.

We next show that Q′ ≺ Q. This contradicts Q ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$. To this end let us note that for all large enough n

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,Q^{\prime })\le \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }g({\pi }^n)S_{\mathrm{\Omega }}^n(P,Q^{\prime })+\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }-{\displaystyle \sum _{\pi \in {\prod }_n\backslash \{{\pi }^n\}}g(\pi )}{\displaystyle \sum _{F\in \pi }°}P(F)\log °Q^{\prime }(F)\\ \le -g({\pi }^n)\log Q^{\prime }({\omega }_{2^n}^n)+\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }-{\displaystyle \sum _{\pi \in {\prod }_n\backslash \{{\pi }^n\}}g(\pi )}{\displaystyle \sum _{F\in \pi }°}P(F)\log Q^{\prime }({\omega }_{2^n}^n)\\ =-g({\pi }^n)\log Q^{\prime }({\omega }_{2^n}^n)-\log \left(Q^{\prime }({\omega }_2^1)\frac{|{\mathrm{\Omega }}_1|}{|{\mathrm{\Omega }}_n|}\right)\cdot {\displaystyle \sum _{\pi \in {\prod }_n\backslash \{{\pi }^n\}}g(\pi )}.\end{array}$$

Since whenever °P (F) > 0, then °Q′(F) is bounded from below by $Q^{\prime }({\omega }_{2^n}^n)$.

Thus, for all large enough n we have

$$\begin{array}{l}0\le \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,Q^{\prime })-g({\pi }^n)\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q^{\prime })\\ \le -\log \left(Q^{\prime }({\omega }_2^1)\frac{|{\mathrm{\Omega }}_1|}{|{\mathrm{\Omega }}_n|}\right)\cdot {\displaystyle \sum _{\pi \in {\prod }_n\backslash \{{\pi }^n\}}g(\pi )}.\end{array}$$

g is regular, hence, this last term converges to zero. We thus obtain

$$\underset{n\to \mathrm{\infty }}{\lim }\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }g({\pi }^n)S_{\mathrm{\Omega }}^n(P,Q^{\prime })-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,Q^{\prime })=0.$$

(17)

Since Q ≠ Q′, Q, Q′ ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ and $Q({\omega }_1^1)=Q^{\prime }({\omega }_1^1)$, there has to exist some minimal k ∈ ℕ a minimal

i ≥ 2^k−1 + 1 such that $Q({\omega }_i^k)<Q^{\prime }({\omega }_i^k)$. We now find for all large enough n that

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,Q)-g({\pi }^n)\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q^{\prime })\ge g({\pi }^n)\cdot \left(\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q)\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q^{\prime })\right)\\ \ge g({\pi }^n)\cdot \left(-\log Q({\omega }_{-}^n)+\log Q^{\prime }({\omega }_{2^n}^n)\right)\\ \ge g({\pi }^n)\cdot \left(-\log \left(Q({\omega }_i^n)\frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_n|}\right)+\log \left(Q^{\prime }({\omega }_{2^i}^k)\frac{|{\mathrm{\Omega }}_k|}{|{\mathrm{\Omega }}_n|}\right)\right)\\ \ge g({\pi }^n)\cdot \left(-\log Q({\omega }_i^k)+\log Q^{\prime }({\omega }_i^k)\right)\\ >0.\end{array}$$

Recall that there exists 0 < a ≤ b such that for all n ∈ ℕ a ≤ g(πⁿ) ≤ b holds. Hence, there exists some constant c > 0 such that $g({\pi }^n)(-\log Q({\omega }_i^k)+\log Q^{\prime }({\omega }_i^k))\ge c>0$. From (17) we conclude that for all large enough n

$$\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,Q)-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,Q^{\prime })>0$$

holds. Thus, Q′ ≺ Q. So, Q ∉ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$.

To complete the proof of Case C1B we show that there exists some N ∈ ℕ such that ${\overline{P}}_N^{†}$ has a strictly better loss profile than Q′.

Let N ∈ ℕ be such that ${\overline{P}}_N^{†}({\omega }_1^1)<Q^{\prime }({\omega }_1^1)$. Analogous to the above it holds that

$$\underset{n\to \mathrm{\infty }}{\lim }\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,{\overline{P}}_N^{†})-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }g({\pi }^n)S_{\mathrm{\Omega }}^n(P,{\overline{P}}_N^{†})=0.$$

(18)

It hence suffices to show that there exists some ε > 0 such that for large enough N ∈ ℕ and all n ≥ N

$$g({\pi }^n)\cdot \left(\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q^{\prime })-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,{\overline{P}}_N^{†})\right)>ϵ.$$

We now recall that $Q^{\prime }({\omega }_1^1)>{\overline{P}}_N^{†}({\omega }_1^1)$. The required inequality follows for large enough n ∈ ℕ

$$\begin{array}{c}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,Q^{\prime })-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,{\overline{P}}_N^{†})=-\log (\frac{1-Q^{\prime }({\omega }_1^1)}{2^{n-1}})+\log (\frac{1-{\overline{P}}_N^{†}({\omega }_1^1)}{2^{n-1}})\\ >ϵ.\end{array}$$

Hence, ${\overline{P}}_N^{†}\prec Q^{\prime }$.

Case C2 There exist an α > 0 and an minimal N₁ such that for all $n\ge N_1{\sum }_{\omega \in {\mathrm{\Omega }}_n}{B}^{\inf }(\omega )\le 1-\alpha$ holds.

We may assume that B^inf is open-minded on $ℒ$^∄. Thus there has to exist some minimal N ≥ N₁ such that $0<P_n^{†}({\omega }_1^1)<B^{\inf }({\omega }_1^1)$ for all n ≥ N. For all large enough n ≥ N we now find

$$\begin{array}{l}\frac{1}{g({\pi }^n)}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B^{\inf })\ge \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,B^{\inf })\\ =\underset{\omega \in {\mathrm{\Omega }}_n\backslash \{{\omega }_{2^{n-1}+1}^n,\dots ,{\omega }_{2^n}^n\}}{\max }-\log B^{\inf }(\omega )\\ =-\log (\underset{\omega \in {\mathrm{\Omega }}_n\backslash \{{\omega }_{2^{n-1}+1}^n,\dots ,{\omega }_{2^n}^n\}}{\max }{B}^{\inf }(\omega ))\\ \ge -\log \frac{1-\alpha -B^{\inf }({\omega }_1^1)}{2^{n-1}}.\end{array}$$

Using (18) we find for all large enough n ∈ ℕ

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,B^{\inf })-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,{\overline{P}}_N^{†})\ge g({\pi }^n)\cdot \left(-\log \frac{1-\alpha -B^{\inf }({\omega }_1^1)}{2^{n-1}}+\log \frac{1-P_N^{†}({\omega }_1^1)}{2^{n-1}}\right)\\ +\left(\log (|{\mathrm{\Omega }}_n|)-\log (|{\mathrm{\Omega }}_n|)-\log ({\overline{P}}_N^{†}({\omega }_{2^N}^N))\right)\cdot {\displaystyle \sum _{{}^{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}}g(\pi )}\\ >0.\end{array}$$

□

Proposition 31. For all regular g and all ϵ > 0 there exists an N ∈ ℕ such that for all n ≥ N

$$\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,{\overline{P}}_N^{†})-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,{\overline{P}}_N^{†})\le ϵ.$$

Proof. Let ϵ > 0 be fixed. By (18) it suffices to show that there exists some N ∈ ℕ such that for all n ≥ N it holds that

$$\begin{array}{l}0\le \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,{\overline{P}}_N^{†})-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,{\overline{P}}_N^{†})\\ \le g({\pi }^n)\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,{\overline{P}}_N^{†})-g({\pi }^n)\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,{\overline{P}}_N^{†})\\ \le ϵ.\end{array}$$

Now simply note that we have proved this already in Proposition 29. □

Hence, for all ϵ > 0 there exists some N ∈ ℕ such that for all n ≥ N and all Q ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$

$$\begin{array}{c}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,P_N^{†})-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,Q)\le \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,P_N^{†})-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_g^n(P,P_N^{†})\\ >ϵ.\end{array}$$

Although, ${\overline{P}}_N^{†}$ is not a minimal element of ≺, the losses incurred by adopting any other B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ can only be marginally better, eventually.

Thus, for fixed k and δ > 0 there exists an N ∈ ℕ such that for all $\phi \in S{\mathrm{ℒ}}_k|{\overline{P}}_N^{†}(\phi )-P_{\mathrm{\Omega }}^{†}(\phi )|<\delta$. Hence, belief functions with an arbitrarily good loss can be found within an (Euclidean) neighbourhood of $P_{\mathrm{\Omega }}^{†}$.

Since the ${\overline{P}}_N^{†}$ are probability functions, there does not exist a B ∈ ${\mathbb{B}}_{\mathrm{ℒ}}$ which dominates ${\overline{P}}_N^{†}$ on $ℒ$^∃ or on $ℒ$^∄. Furthermore, the ${\overline{P}}_N^{†}$ are optimal according to (∀*). The ${\overline{P}}_N^{†}$ thus are almost optimal in all the senses we here considered.

In essence, the phenomenon of minloss ${\mathbb{B}}_{\mathrm{ℒ}}=\varnothing$arises from ${\overline{P}}_{N+1}^{†}$ having a strictly better loss profile than ${\overline{P}}_N^{†}$ but the limit of the sequence ${({\overline{P}}_N^{†})}_{n\in \mathrm{\mathbb{N}}}$ is $P_{\mathrm{\Omega }}^{†}$, which is not open-minded. This phenomenon is reminiscent of min{x ∈ ℝ : 0 < x < 1} = ∅, where it is possible to get ever closer to zero but it is impossible to reach it.

6.2. When Losses Can Be Minimised

The analysis of Section 6.1, shows that there can be no general minimax theorem which covers any evidence that is not finitely generated. On the other hand, we shall see in this section that for certain natural cases evidence which cannot be finitely generated, minimax theorems do obtain.

Let $ℒ$ contain only one m-ary relation symbol, U, and c ∈ [0, 1]. Let ${\nu }_1^n:={\wedge }_{1\le i_1,\dots ,i_m}{}_{\le n}\neg U{t}_{i_1}{t}_{i2}\dots t_{i_m}\in {\mathrm{\Omega }}_n$ and let ${\nu }_2^n,\dots ,{\nu }_{|{\mathrm{\Omega }}_n|}^n$ be an enumeration of the remaining n-states. We shall consider the following example:

$$\begin{array}{l}{\mathbb{E}}_{\mathrm{ℒ}}=\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:\underset{n\to \mathrm{\infty }}{\lim }P({\nu }_1^n)=c\}\\ =\{P\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}:P(\forall x_1{x}_2\dots x_m\neg U{x}_1{x}_2\dots x_m)=c\}.\end{array}$$

Slightly less general versions of ${\mathbb{E}}_{\mathrm{ℒ}}$ have attracted recent interest in the literature [18] (Example 3, p. 95), [19] (Example 3.5, p. 172) and [1] (Example 5.7, p. 99). We here consider relations symbols U of arbitrary arity, while previously U was taken to be unary.

First of all, if c = 0 and g is symmetric and inclusive, then P= ∈ ${\mathbb{E}}_{\mathrm{ℒ}}$ and we immediately obtain that $P_{=}=P_{\mathrm{\Omega }}^{†}$ and $\{P_{=}\}={\mathrm{maxent}\mathbb{E}}_{\mathrm{ℒ}}={\mathrm{minloss}\mathbb{B}}_{\mathrm{ℒ}}$.

We shall assume from now on that c > 0.

Proposition 32. For symmetric and inclusive g it holds that${\mathrm{\mathbb{P}}}^{†}=\{P^{†}\}=\{P_{\mathrm{\Omega }}^{†}\}$ and$P_{\mathrm{\Omega }}^{†}({\nu }_1^n)=c+\frac{1-c}{|{\mathrm{\Omega }}_n|}$ and$P_{\mathrm{\Omega }}^{†}({\nu }_i^n)=\frac{1-c}{|{\mathrm{\Omega }}_n|}$ for all n ∈ ℕ and all 1 ≤ I ≤ |Ω_n|.

Proof. For all n ≥ 2 and symmetric and inclusive g_n it holds that $P_n^{†}({\nu }_2^n)=P_n^{†}({\nu }_2^n)=P_n^{†}({\nu }_{2+i}^n)$ for all 1 ≤ i ≤ |Ω_n| − 2 by [4] (Corollary 7, p. 3577). Thus, there exists some λ_n ≥ 0 such that $P_n^{†}({\nu }_1^n)={\lambda }_n$ and $P_n^{†}({\nu }_k^n)=\frac{1-{\lambda }_n}{|{\mathrm{\Omega }}_n{|}^{-1}}$ for all 2 ≤ k ≤ |Ω_n|.

For all n ∈ ℕ, now define a function P₁ ∈ $[{\mathbb{E}}_n]$ by $P_1({\nu }_1^n):=1$. Then, define a convex combination of the equivocator on ${\mathbb{E}}_n$ and P₁ by $P_{{\lambda }_n}:={\lambda }_n{P}_1+(1-{\lambda }_n)P_{={\downharpoonright }_n}$.. Recall that g_n is equivocator-preserving (Proposition 7) and that $H_g^n$ is strictly concave on ℙ_n (Lemma 1). Thus, $H_g^n(P_{{\lambda }_n})>H_g^n(P_{{{\lambda }^{\prime }}_n})$ for all $0\le {\lambda }_n<{{\lambda }^{\prime }}_n\le 1$.

On the one hand g-entropy strictly increases with decreasing λ_n on the other hand $P_n^{†}\in [{\mathbb{E}}_{\mathrm{ℒ}}]$ imposes the constraint $P_n^{†}({\nu }_1^n)\ge c$.. Let N ∈ ℕ be minimal with $|{\mathrm{\Omega }}_N|>\frac{1}{c}$ Then for all n ≥ N it holds that $P_n^{†}({\nu }_1^n)\ge c$. and $P_n^{†}({\nu }_2^n)=P_n^{†}({\nu }_{2+i}^n)=\frac{1-c}{|{\mathrm{\Omega }}_n|-1}$ for all 1 ≤ i ≤ |Ω_n| −2.

For all r ≥ N it follows that

$$\begin{array}{l}{P}_r^{†}({\nu }_2^N)=P_n^{†}({\nu }_{2+i}^r)\frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_N|}=\frac{1-c|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_r|-1|{\mathrm{\Omega }}_N|}\\ P_r^{†}({\nu }_1^N)=1-(|{\mathrm{\Omega }}_N|-1)\cdot P_r^{†}({\nu }_2^N).\end{array}$$

Thus, for all r ≥ N we find

$$\begin{array}{l}{P}^{†}({\nu }_2^r)=\underset{n\to \mathrm{\infty }}{\lim }{P}_n^{†}({\nu }_2^r)=\frac{1-c}{|{\mathrm{\Omega }}_r|}\\ P^{†}({\nu }_1^r)=\underset{n\to \mathrm{\infty }}{\lim }{P}_n^{†}({\nu }_2^r)\\ =1-(|{\mathrm{\Omega }}_r|-1)P^{†}({\nu }_2^r)\\ =\frac{|{\mathrm{\Omega }}_r|-(|{\mathrm{\Omega }}_r|-1)(1-c)}{|{\mathrm{\Omega }}_r|}\\ =c+\frac{1-c}{|{\mathrm{\Omega }}_r|}\\ =c+P^{†}({\nu }_2^r).\end{array}$$

Thus, for all n ∈ ℕ $P^{†}({\nu }_1^n)=c+\frac{1-c}{|{\mathrm{\Omega }}_n|}$ and $P^{†}({\nu }_2^n)=\frac{1-c}{|{\mathrm{\Omega }}_n|}$.

We now show that P^† is indeed a probability function. We need to show that $\sum \underset{\nu \models \omega }{\nu \in {\mathrm{\Omega }}_{n+1}}{P}^{†}(\nu )=P^{†}(\omega )$ for all n ∈ ℕ and all ω ∈ Ω_n:

$$\begin{array}{l}{P}^{†}({\nu }_i^n)=\frac{1-c}{|{\mathrm{\Omega }}_n|}=\frac{|{\mathrm{\Omega }}_{n+1}|1-c}{|{\mathrm{\Omega }}_n||{\mathrm{\Omega }}_{n+1}|}=\frac{|{\mathrm{\Omega }}_{n+1}|}{|{\mathrm{\Omega }}_n|}{P}^{†}({\nu }_i^{n+1})\text{for all}2\le i\le |{\mathrm{\Omega }}_n|\\ P^{†}({\nu }_1^n)=c+\frac{1-c}{|{\mathrm{\Omega }}_n|}\\ =c+\frac{1-c}{|{\mathrm{\Omega }}_{n+1}|}+(\frac{|{\mathrm{\Omega }}_{n+1}|}{|{\mathrm{\Omega }}_n|}-1)\frac{1-c}{|{\mathrm{\Omega }}_{n+1}|}\\ =P^{†}({\nu }_1^{n+1})+(\frac{|{\mathrm{\Omega }}_{n+1}|}{|{\mathrm{\Omega }}_n|}-1)P^{†}({\nu }_2^{n+1}).\end{array}$$

Finally, observe that ${\mathrm{\mathbb{P}}}_n^{†}=\arg {\sup }_{P\in {\mathbb{E}}_n}{H}_{\mathrm{\Omega }}^n(P)$. Hence, ${\mathrm{\mathbb{P}}}^{†}=\{P_{\mathrm{\Omega }}^{†}\}$. □

Proposition 33. If g = g_Ω or if g is regular, then maxent ${\mathbb{E}}_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}^{†}\}$.

Proof. Let Q ∈ ${\mathbb{E}}_{\mathrm{ℒ}}\backslash \{P_{\mathrm{\Omega }}^{†}\}$. For regular g, it suffices to show that there exists an N ∈ ℕ such that for all $n\ge N{H}_g^n(Q)<H_g^n(P_{\mathrm{\Omega }}^{†})$ holds.

Since $Q\ne P_{\mathrm{\Omega }}^{†}$ there has to exist a minimal N ∈ ℕ and an N-state ω′ ∈ ${\mathrm{\Omega }}_N\backslash \{{\nu }_1^N\}$ such that $Q({\omega }^{\prime })\ne P_{\mathrm{\Omega }}^{†}({\omega }^{\prime })$.

Now define a function Q′: S$ℒ$ → [0, 1] by requiring that Q′ respects logical equivalence, Q and Q′ agree on S$ℒ$_N,

• $Q^{\prime }({\nu }^{\prime }):=\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}Q({\omega }^{\prime })$Q(ω⁰) for all n > N all ν′ ∈ Ω_n with ν′ ⊨ ω′,
• $Q^{\prime }({\nu }_1^n):=Q({\nu }_1^n)$ for all n > N and
• $Q^{\prime }(\nu ):=\frac{1-Q({\nu }_1^n)-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_n|-1-\frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_N|}}$ for all n > N and all ν ∈ Ω_n \ $\{{\nu }_1^n\}$with ν ⊭ ω′

In general, Q′ is not a probability function because

$$Q^{\prime }({\nu }_1^n)<{\displaystyle \sum _{\underset{\omega \models {\nu }_1^n}{\omega \in {\mathrm{\Omega }}_{n+1}}}{Q}^{\prime }(\omega )}.$$

Note that for all $n\ge N{H}_{\mathrm{\Omega }}^n(Q)\le H_{\mathrm{\Omega }}^n(Q^{\prime })$ holds.

We now show that for all large enough n$H_{\mathrm{\Omega }}^n(Q^{\prime })<H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})$ holds. Let us first compute

$$\begin{array}{c}-H_{\mathrm{\Omega }}^n(Q^{\prime })=Q({\nu }_1^n)\log (Q({\nu }_1^n))+\left(\frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_N|}\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}Q({\omega }^{\prime })\right)\log \frac{Q({\omega }^{\prime })\cdot |{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}\\ +(1-Q({\nu }_1^n)-Q({\omega }^{\prime }))\log \frac{1-Q({\nu }_1^n)-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_n|-1-\frac{|{\mathrm{\Omega }}_n|}{|{\mathrm{\Omega }}_N|}}\\ =Q({\nu }_1^n)\log (Q({\nu }_1^n))+Q({\omega }^{\prime })\cdot (\log (Q({\omega }^{\prime }))+\log (\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}))\\ =+(1-Q({\nu }_1^n)-Q({\omega }^{\prime }))\cdot \left(\log (\frac{1-Q({\nu }_1^n)-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_N|-\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}-1})+\log (\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|})\right)\\ +(1-Q({\nu }_1^n)-Q({\omega }^{\prime }))\cdot \log (\frac{1-Q({\nu }_1^n)-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_N|-\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}-1}).\end{array}$$

Since

$$H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})=-(c+\frac{1-c}{|{\mathrm{\Omega }}_n|})\log (c+\frac{1-c}{|{\mathrm{\Omega }}_n|})-(|{\mathrm{\Omega }}_n|-1)\frac{1-c}{|{\mathrm{\Omega }}_n|}\log (\frac{1-c}{|{\mathrm{\Omega }}_n|})$$

we now find with ${\lim }_{n\to \mathrm{\infty }}{Q}^{\prime }(v_1^n)=c$ that

$$\begin{array}{l}\underset{n\to \mathrm{\infty }}{\lim }{H}_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})-H_{\mathrm{\Omega }}^n(Q^{\prime })=-c\log (c)+\underset{n\to \mathrm{\infty }}{\lim }(-(|{\mathrm{\Omega }}_n|-1)\frac{1-c}{|{\mathrm{\Omega }}_n|}\log (\frac{1-c}{|{\mathrm{\Omega }}_n|})\\ +Q({\nu }_1^n)\log (Q({\nu }_1^n))+Q({\omega }^{\prime })\log (Q({\omega }^{\prime }))+(1-Q({\nu }_1^n))(\log (\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}))\\ +(1-Q({\nu }_1^n)-Q({\omega }^{\prime }))\cdot (\log (\frac{1-Q({\nu }_1^n)-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_N|-\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}-1})))\\ =\cancel{-c\log (c)}-(1-c)\log (1-c)+\underset{n\to \mathrm{\infty }}{\lim }(\frac{(1-c)(|{\mathrm{\Omega }}_N|-1)}{|{\mathrm{\Omega }}_n|}\log (|{\mathrm{\Omega }}_n|)\\ \cancel{+c\log (c)}+Q({\omega }^{\prime })\log (Q({\omega }^{\prime }))+(1-Q({\nu }_1^n))(\log (\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|})))\\ +(1-c-Q({\omega }^{\prime }))\cdot (\log (\frac{1-c-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_N|-1}))\\ =-(1-c)\log (1-c)+Q({\omega }^{\prime })\log (Q({\omega }^{\prime }))\\ +(1-c-Q({\omega }^{\prime }))\cdot (\log (\frac{1-c-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_N|-1}))\\ +\underset{n\to \mathrm{\infty }}{\lim }(\frac{(1-c)(|{\mathrm{\Omega }}_n|-1)}{|{\mathrm{\Omega }}_n|}\log (|{\mathrm{\Omega }}_n|)\\ +(1-Q({\nu }_1^n))(\log (|{\mathrm{\Omega }}_N|)-\log (|{\mathrm{\Omega }}_n|)))\\ =-(1-c)\log (\frac{1-c}{|{\mathrm{\Omega }}_N|})+Q({\omega }^{\prime })\log (Q({\omega }^{\prime }))\\ +(1-c-Q^{\prime }({\omega }^{\prime }))\cdot (\log (\frac{1-c-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_N|-1}))\\ +\underset{n\to \mathrm{\infty }}{\lim }\frac{(1-c)(|{\mathrm{\Omega }}_n|-1)}{|{\mathrm{\Omega }}_n|}\log (|{\mathrm{\Omega }}_n|)-(1-Q({\nu }_1^n))\log (|{\mathrm{\Omega }}_n|)\\ \stackrel{Q({\nu }_n^1)\ge c}{\ge }-(1-c)\log (\frac{1-c}{|{\mathrm{\Omega }}_N|})+Q({\omega }^{\prime })\log (Q({\omega }^{\prime }))\\ +(1-c-Q({\omega }^{\prime }))\cdot (\log (\frac{1-c-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_N|-1}))\\ +\underset{n\to \mathrm{\infty }}{\lim }\frac{(1-c)(|{\mathrm{\Omega }}_n|-1)}{|{\mathrm{\Omega }}_n|}\log (|{\mathrm{\Omega }}_n|)-(1-c)\log (|{\mathrm{\Omega }}_n|)\\ =-(1-c)\log (\frac{1-c}{|{\mathrm{\Omega }}_N|})+Q({\omega }^{\prime })\log (Q({\omega }^{\prime }))\\ +(1-c-Q({\omega }^{\prime }))\cdot (\log \frac{1-c-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_N|-1}))\\ +(1-c)\underset{n\to \mathrm{\infty }}{\lim }(\frac{|{\mathrm{\Omega }}_n|-1}{|{\mathrm{\Omega }}_n|}-1)\log (|{\mathrm{\Omega }}_n|)\\ =-(1-c)\log (\frac{1-c}{|{\mathrm{\Omega }}_N|})\\ +Q({\omega }^{\prime })\log (Q({\omega }^{\prime }))+(1-c-Q({\omega }^{\prime }))\cdot (\log (\frac{1-c-Q({\omega }^{\prime })}{|{\mathrm{\Omega }}_N|-1})).\end{array}$$

Since $Q({\omega }^{\prime })\ne \frac{1-c}{|{\mathrm{\Omega }}_N|}$ there exists some ϵ > 0 such that for all large enough n

$$H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})-H_{\mathrm{\Omega }}^n(Q^{\prime })>ϵ>0.$$

This establishes the result for g = g_Ω.

We now turn to regular g.

$$\begin{array}{r}{H}_g^n(P_{\mathrm{\Omega }}^{†})-H_g^n(Q)\ge H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})-H_{\mathrm{\Omega }}^n(Q)-{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}g(\pi ){\displaystyle \sum _{f\in \pi }°Q(F)\log }}°Q(F)\\ \ge H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})-H_{\mathrm{\Omega }}^n(Q^{\prime })-{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}g(\pi ){\displaystyle \sum _{f\in \pi }°Q(F)\log }}°Q(F).\end{array}$$

The last sum goes to zero since g is regular, Corollary 6. Eventually, $H_{\mathrm{\Omega }}^n(P_{\mathrm{\Omega }}^{†})-H_{\mathrm{\Omega }}^n(Q^{\prime })$ is greater some ϵ > 0 as we established in the first part of the proof. Thus, for all large enough n ∈ ℕ and all $Q\in {\mathbb{E}}_{\mathrm{ℒ}}\backslash \{P^{†}\}$ we have

$$H_g^n(P_{\mathrm{\Omega }}^{†})-H_g^n(Q)>0.$$

□

Lemma 12. The following three conditions are equivalent for all large enough n ∈ ℕ and inclusive and symmetric g

• $P\prime ϵ\arg {\sup }_{P\in E_{\mathrm{ℒ}}}{S}_g^n(P,P_{\mathrm{\Omega }}^{†})$
• $P^{\prime }({\nu }_1^n)=c$
• $P^{\prime }\in \arg {\sup }_{P\in E_{\mathrm{ℒ}}}{S}_{\mathrm{\Omega }}^n(P,P_{\mathrm{\Omega }}^{†})$

Proof. Note that for all P ∈ ℙ_$ℒ$

$$\begin{array}{l}{S}_g^n(P,P_{\mathrm{\Omega }}^{†})=-{\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n}g(\pi ){\displaystyle \sum _{F\in \pi }°P}(F)\log °P_{\mathrm{\Omega }}^{†}(F)}\\ =-{\displaystyle \sum _{\nu \in {\mathrm{\Omega }}_n}P(\nu ){\displaystyle \sum _{\underset{{}^{\nu \in F}}{F\subseteq {\mathrm{\Omega }}_n}}{\gamma }_n(F)\log }°P_{\mathrm{\Omega }}^{†}(F)}\\ =-P({\nu }_1)\left({\gamma }_n({\nu }_1)\log P_{\mathrm{\Omega }}^{†}({\nu }_1)+{\displaystyle \sum _{\underset{|F|\ge 2}{\overset{F\subseteq {\mathrm{\Omega }}_n}{{\nu }_1\in F}}}{\gamma }_n(F)\log °P_{\mathrm{\Omega }}^{†}(F)}\right)\\ +{\displaystyle \sum _{i=2}^{|{\mathrm{\Omega }}_n|}-P({\nu }_i)\left({\gamma }_n({\nu }_i)\log P_{\mathrm{\Omega }}^{†}({\nu }_i)+{\displaystyle \sum _{\underset{|F|\ge 2}{\overset{F\subseteq {\mathrm{\Omega }}_n}{{\nu }_i\in F}}}{\gamma }_n(F)\log °P_{\mathrm{\Omega }}^{†}(F)}\right).}\end{array}$$

The term between the last set of brackets () does not depend on i. So, $S_g^n(P,P_{\mathrm{\Omega }}^{†})$ only depends on P(ν₁) but not on how P distributes probabilities among the other n-states.

For large enough N ∈ ℕ it holds that $P_{\mathrm{\Omega }}^{†}({\nu }_1)>P_{\mathrm{\Omega }}^{†}({\nu }_2)=P_{\mathrm{\Omega }}^{†}({\nu }_i)$ for all 3 ≤ i ≤ |Ω_n|.

Since g is symmetric, γ_n(F) is only a function of the size of F, |F|, it follows that every $P^{\prime }\in \arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n(P,P_{\mathrm{\Omega }}^{†})$ assigns as little probability as possible to ν₁. Since we require that $P\in {\mathbb{E}}_{\mathrm{ℒ}}$ it follows that P′(ν₁) = c.

The result for $S_{\mathrm{\Omega }}^n$ follows as above by noting that for g = g_Ω it holds that γ_n(ν) = 1 for all n-states ν ∈ Ω_n and γ_n(F) = 0 otherwise. □

Adapting Joyce’s notion of truth-directedness [14] we define:

Definition 26 (Chance-directed scoring rule). A function F^f: [0, 1] × [0, 1] → [0, +∞] of the form F^f (x, y) = x · f(y) + (1 − x) · f(1 − y) is called chance-directed, if and only if for all x ∈ [0, 1], all 0 ≤ λ < 1 and all y ∈ [0, 1] \ {x}

$$\begin{array}{l}{F}^f(x,y)=x\cdot f(y)+(1-x)\cdot f(1-y)\\ >x\cdot f((1-\lambda )x+\lambda y)+(1-x)\cdot f(1-(1-\lambda )x-\lambda y)\\ =F^f(x,(1-\lambda )x+\lambda y)\end{array}$$

holds. For a scoring rule F^f this formalises the idea that beliefs which are closer to the chances on two mutually exclusive and exhaustive events are strictly better scored.

In particular, F^f(x, y) = −x log y − (1 − x) log(1 − y) is chance-directed. The score improves by simultaneously moving y closer to x and 1 − y closer to 1 − x.

Proposition 34. If g is regular, then all B ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$ agree with$P_{\mathrm{\Omega }}^{†}$ on $ℒ$^∄.

Proof. If c = 1, then $|{\mathbb{E}}_{\mathrm{ℒ}}|=1$ and maxent ${\mathbb{E}}_{\mathrm{ℒ}}=\{P_{\mathrm{\Omega }}^{†}\}$ follows trivially. By Theorem 5 we have that for every function $B^{\prime }\in \arg {\inf }_{B\in {\mathbb{B}}_{\mathrm{ℒ}}}{\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n(P,B)$ it holds that ${B^{\prime }}_{\downharpoonright n}=P_{\mathrm{\Omega }\downharpoonright n}^{†}$. Thus, all B ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$ agree with $P_{\mathrm{\Omega }}^{†}$ on $ℒ$^∄.

We now focus on 0 < c < 1.

From the above lemma we obtain

$$\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,P_{\mathrm{\Omega }}^{†})=-c\log \left(c+\frac{1-c}{|{\mathrm{\Omega }}_n|}\right)-(1-c)\log \left(\frac{1-c}{|{\mathrm{\Omega }}_n|}\right).$$

We now follow the structure of the proof of Proposition 16 for fixed 0 < c < 1. Let B ∈ minloss ${\mathbb{B}}_{\mathrm{ℒ}}$.

Case1$B\in {\mathrm{\mathbb{P}}}_{\mathrm{ℒ}}\backslash \{P_{\mathrm{\Omega }}^{†}\}$.

Case1A$B\in [{\mathbb{E}}_{\mathrm{ℒ}}]\backslash \{P_{\mathrm{\Omega }}^{†}\}$.

If there exists an n ∈ ℕ such that $B\left({\nu }_1^n\right)>P_{\mathrm{\Omega }}^{†}\left({\nu }_1^n\right)$, then ${\displaystyle {\sum }_{\nu \in {\mathrm{\Omega }}_n\backslash \{{\nu }_1^n\}}B(\nu )<}{\displaystyle {\sum }_{\nu \in {\mathrm{\Omega }}_n\backslash \{{\nu }_1^n\}}{P}_{\mathrm{\Omega }}^{†}(\nu )}$. If there exists an m ∈ ℕ such that $B\left({\nu }_1^m\right)>P_{\mathrm{\Omega }}^{†}\left({\nu }_1^m\right)$, then there has to exist some k > m such that

$${\displaystyle \sum _{\underset{\nu \models {\nu }_1^{k-1}}{\nu \in {\mathrm{\Omega }}^k\backslash \{{\nu }_1^k\}}}B(\nu )<{\displaystyle \sum _{\underset{\nu \models {\nu }_1^{k-1}}{\nu \in {\mathrm{\Omega }}^k\backslash \{{\nu }_1^k\}}}{P}_{\mathrm{\Omega }}^{†}(\nu ).}}$$

Since $B\ne P_{\mathrm{\Omega }}^{†}$ either such an n ∈ ℕ or such a k ∈ ℕ has to exist, possibly both exist. Overall, there has to exist some N ∈ ℕ, a ${\nu }^N\in {\mathrm{\Omega }}_N\backslash \{{\nu }_1^N\}$ and an ϵ > 0 such that $B({\nu }^N)+ϵ=P_{\mathrm{\Omega }}^{†}({\nu }^N)$.

For large enough n ∈ ℕ, depending on B, $ℒ$ and c, it holds that

$$\begin{array}{l}\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,B)\ge -c\log B({\nu }_1^n)-(1-c)\log \left(B\left({\nu }^N\right)\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}\right)\\ >-c\log B({\nu }_1^n)-(1-c)\log \left((B({\nu }^N)+\frac{ϵ}{2})\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}\right)\\ \underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,P_{\mathrm{\Omega }}^{†})=-c\log \left(c+\frac{1-c}{|{\mathrm{\Omega }}_n|}\right)-(1-c)\log \left(P_{\mathrm{\Omega }}^{†}\left({\nu }^N\right)\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}\right).\end{array}$$

Since we may assume that $B({\nu }_1^n)$ converges in n to c$B\in {\mathbb{E}}_{\mathrm{ℒ}}$ we now find

$$\begin{array}{l}\underset{n\to \mathrm{\infty }}{\lim }\frac{{\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_{\mathrm{\Omega }}^n(P,B)-{\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_{\mathrm{\Omega }}^n(P,P_{\mathrm{\Omega }}^{†})}{1-c}\\ \ge \underset{n\to \mathrm{\infty }}{\lim }-\log \left(B({\nu }^N)\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}\right)+\log \left(P_{\mathrm{\Omega }}^{†}({\nu }^N)\frac{|{\mathrm{\Omega }}_N|}{|{\mathrm{\Omega }}_n|}\right)\\ >-\log (B({\nu }^N)+\frac{ϵ}{2})+\log P_{\mathrm{\Omega }}^{†}({\nu }^N)\\ >0.\end{array}$$

Whether this limit exists or not, we have thus established that for large enough n ∈ ℕ there exists a lower bound of the sequence

$${(\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,B)-\underset{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{\sup }{S}_{\mathrm{\Omega }}^n(P,P_{\mathrm{\Omega }}^{†}))}_{n\in \mathrm{\mathbb{N}}}$$

which is strictly positive, since we take N ∈ ℕ to be fixed here.

For all fixed n ∈ ℕ let ${P^{\prime }}_n\in {\mathbb{E}}_{\mathrm{ℒ}}$ be such that ${P^{\prime }}_n({\omega }_1^n):=c$ and ${P^{\prime }}_n({\omega }_2^n):=1-c$. Note that ${P^{\prime }}_n\in \arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_g^n(P,P_{\mathrm{\Omega }}^{†})$ for all large enough n and ${P^{\prime }}_n\in \arg {\sup }_{P\in {\mathbb{E}}_{\mathrm{ℒ}}}{S}_{\mathrm{\Omega }}^n(P,P_{\mathrm{\Omega }}^{†})$ for all large enough n, Lemma 12.

To simplify notation let $R_n:={\displaystyle {\sum }_{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}-g(\pi ){\displaystyle {\sum }_{F\in \pi }°{P^{\prime }}_n}(F)\log °P_{\mathrm{\Omega }}^{†}}(F)$. With this notation we have for all large enough n ∈ ℕ

$$\begin{array}{l}0\le R_n={\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}-g(\pi ){\displaystyle \sum _{F\in \pi }°{P^{\prime }}_n}(F)\log °P_{\mathrm{\Omega }}^{†}}(F)\\ \le {\displaystyle \sum _{\pi \in {\mathrm{\Pi }}_n\backslash \{{\pi }^n\}}-g(\pi ){\displaystyle \sum _{F\in \pi }°{P^{\prime }}_n}(F)\log \frac{1-c}{|{\mathrm{\Omega }}_n|}}\end{array}$$