Abstract
Natural exponential families admit two complementary structural descriptions: through their variance functions and through the information geometry generated by relative entropy and Fisher information. This paper establishes a direct connection between these descriptions. For a regular one-dimensional natural exponential family, we show that a fixed global direction of Kullback–Leibler asymmetry is equivalent to monotonicity of the variance function and, equivalently, to a fixed sign of the standardized skewness. In fact, a local ordering condition around each parameter point already forces the same ordering globally. We then reparametrize the family by Fisher–Rao arc length, which coincides with the classical variance-stabilizing coordinate, and study local spatial homogeneity of information divergence. Local homogeneity of the directed Kullback–Leibler divergence, of its antisymmetric part, of the magnitude of that asymmetry, or local radiality of Jeffreys divergence are shown to be equivalent. Each condition forces constant standardized skewness and consequently characterizes, up to a nonsingular affine transformation, precisely the normal location and fixed-shape gamma natural exponential families. Thus, weak local information conditions determine the global structure of the family. We further show that the global conclusions already follow from a sequential local ordering in the first theorem, and that position-independence of either the leading cubic KL-asymmetry coefficient or the quartic Jeffreys-excess coefficient alone yields the same normal/gamma rigidity.
Keywords:
natural exponential family; variance function; Kullback–Leibler divergence; Fisher–Rao metric; Jeffreys divergence; skewness; information geometry MSC:
62E10; 94A17
1. Introduction
Natural exponential families (NEFs) form one of the central structural classes of mathematical statistics. Their importance derives not only from the canonical form of their likelihoods but also from the fact that much of their probabilistic and statistical structure is encoded by a single function: the variance expressed as a function of the mean. This variance-function point of view has generated a substantial classification theory. Morris classified the six univariate NEFs with quadratic variance functions and subsequently developed their statistical theory [1,2]. Letac and Mora extended the classification program to cubic variance functions [3], while the broader role of variance functions in exponential dispersion models is developed in Jørgensen [4].
A related line of research has used the variance function as a characterization device for particular structural properties of NEFs. Bar-Lev and Enis linked reproducibility to power variance functions [5]. The mean-value parametrization and the fact that an NEF is characterized by its variance function on its mean domain were revisited by Bar-Lev and Kokonendji [6]. More recently, Bar-Lev studied NEFs with bounded variance functions despite unbounded support [7]. These works illustrate a recurring principle: a property initially formulated in terms of distributions, support, convolution, or parametrization often becomes more transparent after translation into variance-function language.
A second line of work relevant to the present paper concerns variance-stabilizing transformations. Bar-Lev and Enis studied both the classical choice and the construction of classes of such transformations [8,9]. If an NEF has variance function V, the basic variance-stabilizing coordinate is obtained from
The same coordinate will arise below from a different direction: it is precisely Fisher–Rao arc length when the family is parametrized by its mean. Thus, the classical statistical theory of variance stabilization and the intrinsic geometry of the family meet at the coordinate that is central to our rigidity results.
There are also several characterization results that single out small collections of classical exponential families. Harremoøes showed that exact renormalized saddlepoint approximation in one-dimensional exponential families selects the Gaussian, gamma, and inverse Gaussian families [10]. A recent result of Bar-Lev gives another characterization of the same triple through a converse problem for a mixed parametrization of a two-parameter exponential family [11]. The criterion studied in the present paper is different and more selective: information homogeneity on the intrinsic Fisher scale will retain the normal and gamma families but exclude the inverse Gaussian family.
The second body of literature underlying this paper is information geometry. Kullback and Leibler introduced relative entropy as a fundamental measure of statistical discrepancy [12]. The geometry of exponential families was developed by Efron [13], Eguchi [14], and Amari and Nagaoka [15]. In a regular exponential family, Kullback–Leibler divergence is a Bregman divergence associated with the cumulant function; the close connection between regular exponential families and Bregman divergences is discussed, for example, by Banerjee et al. [16]. Eguchi and Copas emphasized, among other aspects, the statistical interpretation and asymmetry of Kullback–Leibler divergence [17]. Matúš studied variance functions and information divergences simultaneously in exponential families near the boundary of the convex support [18].
Unlike a metric, Kullback–Leibler divergence is directional:
in general. Locally, its quadratic term is governed by Fisher information, whereas its third-order behavior contains the cubic information tensor. In a one-dimensional NEF, this third-order quantity is directly related to standardized skewness. This raises a natural question that is global rather than local: can the sign of a local third-order distributional characteristic determine the direction of relative entropy between every pair of distributions in the family?
Our first result gives an exact affirmative answer. For a regular nondegenerate one-dimensional NEF, the inequality
holds for every pair if and only if the variance function is nondecreasing, equivalently if and only if standardized skewness is nonnegative throughout the family. More strongly, it is enough to impose the corresponding ordering only for sufficiently close symmetric pairs around each parameter point. That weak local requirement forces monotonicity of the variance function and hence the global ordering for all pairs. The first main result is therefore a local-to-global directionality theorem.
Direction alone does not determine the amount of asymmetry. The canonical parameter is not an intrinsic unit of statistical separation, because Fisher information varies along the family. We therefore pass to Fisher–Rao arc length. In the mean parametrization this coordinate is
which is exactly the classical variance-stabilizing coordinate. On this intrinsic scale, we ask a second question: if two pairs of distributions have the same sufficiently small Fisher–Rao separation, must they exhibit the same amount of Kullback–Leibler non-reversibility?
The use of Fisher–Rao arc length is essential to the formulation of this question. For two nearby distributions separated by a Fisher displacement h, the quadratic term of Kullback–Leibler divergence is universally . Thus, equal Fisher displacement places different pairs on the same local information scale. Any remaining dependence of the cubic and higher-order terms on the base point then measures genuine variation in information asymmetry rather than variation in local Fisher information. In this sense, local translation homogeneity asks whether statistically equally separated pairs exhibit the same directed information discrepancy wherever they are located in the family; local radiality of Jeffreys divergence asks the analogous question for the symmetrized discrepancy.
Our principal rigidity theorem shows that even a local version of this homogeneity requirement is extremely restrictive. We prove that each of the following local properties is equivalent to the others: the directed Kullback–Leibler divergence depends only on signed Fisher displacement; its antisymmetric part depends only on signed Fisher displacement; the magnitude of that antisymmetric part depends only on Fisher–Rao distance; and Jeffreys divergence depends only on Fisher–Rao distance. Each condition forces the standardized skewness to be constant. Solving the resulting variance-function equation yields only a positive constant or the square of an affine function. Consequently, up to a nonsingular affine transformation, the family must be either a normal location NEF or a fixed-shape gamma NEF. Once this conclusion is reached, the initially local information homogeneity automatically becomes global. We also prove that Theorem 1 needs only a sequence of local symmetric comparisons approaching each point, and that the normal/gamma conclusion of Theorem 2 already follows if only the leading KL-asymmetry or Jeffreys-excess coefficient is position-independent.
This conclusion is related to, but distinct from, several recent geometric results. Nielsen and Okamura derive invariance of f-divergences and Fisher–Rao distance from transformation-group actions [19]. Their direction is from an assumed symmetry of the statistical model to an invariant divergence. Here, the logic is converse-like within the class of NEFs: an intrinsic divergence homogeneity condition forces normal-location or gamma-scale structure. Nielsen and Okamura have also studied dual-connection midpoint means and, in dimension one, the role of a constant cubic form [20]. Tojo and Yoshino recently showed that constant Hessian sectional curvature for an order-one exponential family is essentially equivalent to belonging to the full NEF-QVF class [21]. Our conditions are different and substantially more selective: information homogeneity on the Fisher scale leaves only the normal and affine-gamma cases. General upper bounds of Fisher–Rao distance by Jeffreys–Bregman quantities are also known for Hessian statistical manifolds [22]; we use only their elementary one-dimensional NEF specialization and focus on the associated equality rigidity.
To the best of our knowledge, no previous result establishes that local or global orientation of Kullback–Leibler divergence within a one-dimensional NEF is equivalent to monotonicity of its variance function and to a fixed sign of standardized skewness. More importantly, we are not aware of a characterization showing that local spatial homogeneity of Kullback–Leibler asymmetry, or local radiality of Jeffreys divergence, after Fisher–Rao normalization forces constant standardized skewness and hence, up to affine transformation, precisely the normal and fixed-shape gamma NEFs. The classical local relationship between divergence, Fisher information, and third-order information is not claimed as new, nor are general Bregman or Fisher–Jeffreys inequalities. The novelty lies in the local-to-global NEF consequences of these information-asymmetry conditions.
More precisely, the individual analytic ingredients used below—the Bregman form of Kullback–Leibler divergence in exponential families, its local Fisher expansion, and the relation between the third cumulant and the derivative of the variance function—are classical. The contribution is the exact set of equivalences and rigidity consequences obtained when these ingredients are combined with the one-dimensional NEF structure. In Theorem 1, a condition imposed only on sufficiently close symmetric pairs determines the Kullback–Leibler orientation for every pair in the family. In Theorem 2, the assumptions are exact local functional homogeneity conditions on the divergence functions themselves, not merely constancy of a Taylor coefficient; these local conditions determine the complete full NEF up to affine equivalence.
The paper is organized as follows. Section 2 introduces the NEF framework, variance functions, Kullback–Leibler and Jeffreys divergences, and Fisher–Rao parametrization. It also records the local divergence expansion that exposes standardized skewness. Section 3 establishes the local-to-global directionality theorem. Section 4 proves the information-homogeneity rigidity theorem and the normal/gamma classification, and records the Jeffreys–Fisher equality consequence. Section 5 examines the main classical NEFs and illustrates the difference between directionality and rigidity. Section 6 discusses the relation with the surrounding literature and the interpretation of the results. Section 7 concludes.
2. Preliminaries and Local Information Asymmetry
Let be a nondegenerate positive measure on and let
We assume that
is a nonempty open interval. Throughout the paper, the NEF is the full regular family generated by ,
where
The cumulant function is analytic and strictly convex on . Hence,
is strictly increasing and
Let be the mean domain and let . The variance function is
The pair consisting of the mean domain and variance function characterizes the NEF in the usual sense; see [1,4,6].
Differentiating gives
Therefore, the standardized third cumulant, or skewness, is
Thus, the sign of skewness is exactly the sign of the derivative of the variance function.
For , direct calculation gives
The Jeffreys divergence is
and hence
The Fisher information for the canonical parameter is
We introduce increasing Fisher–Rao arc length by
Because ,
Thus, s is, up to an additive constant, the classical variance-stabilizing coordinate studied in [8,9]. Let , define
and put
Then
and, by (1),
The classical information-geometric theory implies that the first asymmetric term of a smooth divergence is third order [13,14,15]. For later use, we record its explicit form in Fisher coordinates for a one-dimensional NEF.
In the following proposition, we express the leading local Kullback–Leibler asymmetry directly in terms of standardized skewness.
Proposition 1.
For a regular nondegenerate one-dimensional NEF parametrized by Fisher–Rao arc length,
and
Consequently,
and
Proof.
From (2) and (6), differentiation with respect to the second Fisher coordinate gives
Therefore
Taylor expansion of the numerator and denominator at s gives
Since by (7), (8) follows. Reversing the arguments gives (9). Indeed, the reversed expansion may be written with base point ; since , replacing by changes the cubic term only by . Subtraction and division by give (10) and (11). □
3. A Local-to-Global Directionality Theorem
The local expansion (10) shows that skewness determines the infinitesimal direction of Kullback–Leibler asymmetry. We now show that, within an NEF, this local sign information propagates globally.
In the following theorem, we establish that it is enough to impose Kullback–Leibler ordering for sufficiently close symmetric pairs around each canonical parameter value; this local condition is equivalent to monotonicity of the variance function and hence to a global ordering for every pair in the family.
Theorem 1.
Let be a regular nondegenerate one-dimensional NEF. The following statements are equivalent.
- (i)
- For every ,
- (ii)
- For every , there exists such that, whenever and ,
- (iii)
- is nondecreasing on Θ.
- (iv)
- is nondecreasing on M.
- (v)
- for every .
Proof.
Statement (i) immediately implies (ii). We prove that (ii) implies (iii). From (2), Taylor’s formula with integral remainder gives, for ,
and
For and , subtraction yields
As ,
Condition (ii) therefore implies for every , and hence is nondecreasing. Thus, (ii) implies (iii).
Suppose next that (iii) holds. The integrand in (17) is nonnegative for every for which the points belong to . Therefore, (14) holds for every , so (iii) implies (i).
Since , the canonical parameter and the mean induce the same ordering. Hence, is nondecreasing in if and only if is nondecreasing in m. Thus, (iii) and (iv) are equivalent. Finally, (1) and positivity of V show that (iv) and (v) are equivalent. □
The reversed version follows by changing all inequalities: V is nonincreasing if and only if skewness is nonpositive if and only if the reverse Kullback–Leibler ordering holds globally. Thus, Theorem 1 gives a complete sign characterization.
In the following corollary, we record the strict form of the result when the family is nonnormal.
Corollary 1.
Assume the equivalent conditions of Theorem 1. If the variance function is not constant, then for every ,
Proof.
Under monotonicity, the integrand in (17) is nonnegative. Equality for one distinct pair would imply equality of at the two endpoints of a nontrivial interval. A monotone function with equal endpoint values is constant on that interval. Since is analytic, it would then be constant on the whole connected canonical parameter domain, contrary to the assumption. □
Corollary 2
(Sequential local criterion). In Theorem 1(ii), it is enough to require the Kullback–Leibler ordering along a sequence tending to each parameter point. More precisely, suppose that for every there exists a sequence , with , such that
Then, the equivalent conclusions of Theorem 1 hold: and V are nondecreasing, , and the same Kullback–Leibler orientation holds for every ordered pair in the family.
Proof.
Using (18) along the sequence gives
After division by and passage to the limit, . Since c is arbitrary, the remainder follows from Theorem 1. □
The orientation in Theorem 1 is tied to the increasing canonical/mean ordering. If the observation variable is reflected, , Kullback–Leibler divergence itself is unchanged under this one-to-one transformation, but the induced mean ordering is reversed and standardized skewness changes sign. Accordingly, the displayed orientation is reversed when it is expressed relative to the increasing mean of the reflected family.
The preceding theorem separates two issues. A fixed sign of skewness controls the orientation of Kullback–Leibler asymmetry, but it does not make the amount of asymmetry independent of position in the family. That stronger property is considered next.
4. Information Homogeneity and Rigidity
We first formalize the local homogeneity conditions used below.
Definition 1.
Let S be the Fisher-coordinate interval. A function is called pointwise locally translation-homogeneous if, for every , there exists an open interval containing and a one-variable function such that
It is called pointwise locally radial if, for every , there exists such an interval and a function for which
The definition is deliberately weak: both the interval and the representing one-variable function may vary with , and no behavior is assumed for widely separated members of the family. The main result shows that these pointwise local requirements already determine the entire NEF.
It is worth stressing that the hypotheses below are functional hypotheses: on each local interval, the full divergence (or its indicated symmetric/antisymmetric component) must be a function only of displacement. They are therefore stronger functional statements than constancy of a single leading Taylor coefficient. The proof uses the local identities to extract constant standardized skewness, after which the NEF structure propagates the pointwise local condition to a global classification.
For the directed Kullback–Leibler divergence, the following exact identity complements the local Taylor expansion and will be useful in the proof of the rigidity theorem.
Lemma 1.
For Fisher coordinates ,
Proof.
In the following theorem, we show that even pointwise local spatial homogeneity of Kullback–Leibler or Jeffreys divergence on the Fisher scale is rigid: a condition imposed separately in arbitrarily small neighborhoods of each Fisher point forces the global family to be normal or gamma.
Theorem 2.
Let be a full regular nondegenerate one-dimensional NEF parametrized by increasing Fisher–Rao arc length, and define
The following statements are equivalent.
- (i)
- is pointwise locally translation-homogeneous.
- (ii)
- is pointwise locally translation-homogeneous.
- (iii)
- is pointwise locally radial.
- (vi)
- is pointwise locally radial.
- (v)
- The standardized skewness is constant on the family.
- (vi)
- The variance function has one of the formsor
- (vii)
- Up to a nonsingular affine transformation of the observation, including reflection when required, the NEF is either a normal location family or a fixed-shape gamma family.
Moreover, whenever these equivalent conditions hold, the local homogeneity in (i)–(iv) extends to every admissible pair in S.
Proof.
Suppose first that (i) holds. Fix and choose and from the definition. For ,
Since the left-hand side is smooth, is smooth near zero. By Lemma 1,
Writing and taking logarithms gives
for and sufficiently small h. Differentiating with respect to h at shows that is constant on . By (7), is therefore locally constant. Because S is connected, a locally constant function on S is constant. Thus, (i) implies (v).
Suppose (ii) holds. Fix and an interval on which
For every , (11) gives
The right-hand side is independent of s, so is constant on . Connectedness of S again yields global constancy. Hence, (ii) implies (v).
Suppose (iii) holds. Fix and write
Then, (10) implies
Thus, is constant on . Since is connected and is continuous, itself is constant there: if the common absolute value is positive, its sign cannot change, and if it is zero, then vanishes. Hence, is locally constant on S and therefore globally constant. This proves (iii)⇒(v).
Suppose (iv) holds. Fix and write
By (13),
Thus, is constant on , and the same continuity argument shows that is constant there. Hence, is globally constant on the connected interval S. Therefore, (iv) implies (v).
Assume now that (v) holds and write . By (1),
Therefore,
so
If , V is constant and (20) holds. If , (22) is equivalent to (21). Thus, (v) implies (vi). Conversely, either variance-function form in (vi) gives constant standardized skewness by (1); hence, (v) and (vi) are equivalent.
We next identify the corresponding full NEFs. If , then and
which is the cumulant function of a normal location family up to translation. Uniqueness of the Laplace transform identifies the generating measure, and the fullness assumption recovers the corresponding maximal canonical family.
Suppose instead that . Translate the observation by b. On the connected mean domain, has a fixed sign. After a possible reflection, we may assume and
Put . Since
integration gives
and hence
A further integration yields
apart from the linear term associated with the removed translation. Hence, the Laplace transform agrees on a nonempty open interval with that of a fixed-shape gamma law. Uniqueness of the Laplace transform identifies the generating measure (up to the already removed affine change) with the corresponding gamma measure. Since the NEF is full, its canonical parameter domain is the interior of the complete domain of that Laplace transform, namely, the maximal half-line. Thus, the full family is the affine image, with possible reflection, of a fixed-shape gamma NEF. This proves (vi) implies (vii). Conversely, normal and fixed-shape gamma NEFs have, respectively, constant zero and constant nonzero standardized skewness, so (vii) implies (v).
It remains to show that constant skewness gives the local homogeneity properties and indeed makes them global. By (7),
Put
If , g is constant and direct integration gives
If , then
for some . Substitution into the integral representation used in Proposition 1 gives
The right-hand side depends only on h for every admissible pair. Therefore, (v) implies (i), and consequently (ii) and (iii). Addition of the formula with h replaced by shows that Jeffreys divergence depends only on , so (iv) also holds. The same calculation proves the final global-extension assertion. □
Theorem 2 is the central rigidity statement. It is important that the assumptions in (i)–(iv) are pointwise local: neither a single common neighborhood of the diagonal nor a single common representing function is assumed in advance. Information homogeneity around arbitrarily small neighborhoods of individual Fisher points nevertheless determines the entire variance function and therefore the entire full NEF.
Corollary 3
(Coefficient-level rigidity). Let be as in Theorem 2. Define the local Kullback–Leibler asymmetry coefficient and the local Jeffreys excess coefficient by
and
If either is independent of s or is independent of s, then the standardized skewness is constant and hence, up to a nonsingular affine transformation, the full NEF is normal or fixed-shape gamma. Conversely, the normal and fixed-shape gamma NEFs satisfy both coefficient-homogeneity properties.
Proof.
In the following corollary, we give the divergence functions explicitly and display the normal family as the zero-skewness limit of the gamma geometry.
Corollary 4.
Under the equivalent conditions of Theorem 2, let . If the family is normal, then
and
If the constant standardized skewness is nonzero and , then
and
As , these expressions converge to the normal formulas.
Proof.
General Jeffreys–Bregman upper bounds on Fisher–Rao distance are known in Hessian statistical geometry [22]. In one dimension, the NEF specialization follows immediately from (12). The next proposition is included because its equality case provides a useful normal rigidity statement.
In the following proposition, we record the one-dimensional Jeffreys–Fisher inequality and show that equality at even one nontrivial pair forces normality.
The inequality itself is a direct Cauchy–Schwarz consequence and is not claimed as new. The NEF-specific point used here is the rigidity of equality: equality for a single distinct pair forces constancy on an interval, and analyticity then propagates that constancy to the full connected family.
Proposition 2.
For any two members and of a regular nondegenerate one-dimensional NEF,
If equality holds for one pair with , then the NEF is a normal location family up to a nonsingular affine transformation.
5. Classical Examples
The examples below show why the directionality theorem and the rigidity theorem are genuinely different. Several important NEFs have a fixed global Kullback–Leibler direction but fail information homogeneity because their standardized skewness is not constant.
5.1. Normal Family
For a normal location NEF with fixed variance ,
The Kullback–Leibler divergence is symmetric and the family satisfies all conditions of Theorem 2. It is the homogeneous reversible case.
5.2. Gamma Family
For a fixed-shape gamma NEF with shape parameter ,
and
The skewness is positive and constant. The gamma family therefore satisfies both the global directionality theorem and the full rigidity theorem. It is the homogeneous nonreversible case: after Fisher normalization, Kullback–Leibler asymmetry is nonzero but independent of position.
5.3. Poisson Family
For the Poisson NEF,
so
Theorem 1 therefore yields a strict global Kullback–Leibler direction, but the skewness is not constant. Hence, Poisson fails the information-homogeneity conditions of Theorem 2.
The contrast with the gamma family is particularly transparent at a fixed Fisher displacement h. For gamma, Corollary 4 gives
which is independent of the base point s. For Poisson, the Fisher coordinate may be chosen as , so that and . Hence, from (10),
Thus, Poisson has the same KL orientation throughout the family, but the magnitude of the local asymmetry varies with position; gamma has both fixed orientation and Fisher-scale homogeneity.
5.4. Negative Binomial Family
For a negative binomial NEF with fixed shape parameter ,
Thus,
which is positive but nonconstant. The family has a fixed global Kullback–Leibler direction but does not satisfy the rigidity theorem.
5.5. Inverse Gaussian Family
For the inverse Gaussian NEF in the usual fixed-dispersion normalization,
and therefore
Again, the variance function is increasing, so the global Kullback–Leibler direction is fixed, but standardized skewness is not constant. This comparison is especially informative because the inverse Gaussian joins normal and gamma in the exact-saddlepoint characterization of Harremoøes [10] and in the mixed-parametrization characterization of Bar-Lev [11]; the information-homogeneity criterion developed here separates it from the other two.
5.6. Binomial Family
For a binomial NEF with size parameter n,
Its derivative changes sign at . Consequently standardized skewness changes sign and no single Kullback–Leibler orientation holds on the full family. The direction reverses as the mean passes through the midpoint.
5.7. Generalized Hyperbolic Secant Family
In a standard normalization of the generalized hyperbolic secant NEF,
so
The skewness changes sign at zero. Thus, the family belongs to the Morris NEF-QVF class [1,2] but has neither a single global Kullback–Leibler direction nor Fisher-scale information homogeneity. This provides a simple illustration of the distinction between quadratic variance and the much stronger perfect-square condition in Theorem 2.
For convenience, the examples may be summarized as follows:
| Family | Variance Function | KL Orientation | Fisher Homogeneity |
| Normal | symmetric | yes | |
| Gamma | fixed, positive-skew direction | yes | |
| Poisson | m | fixed, positive-skew direction | no |
| Negative binomial | fixed, positive-skew direction | no | |
| Inverse Gaussian | fixed, positive-skew direction | no | |
| Binomial | changes at | no | |
| Hyperbolic secant | changes at | no |
These examples yield a useful hierarchy. Poisson, negative binomial, and inverse Gaussian satisfy the directionality theorem but not the rigidity theorem. Binomial and generalized hyperbolic secant fail even global directionality on their full mean domains. Only normal and gamma satisfy the homogeneity theorem.
6. Discussion
The main results connect three descriptions of a one-dimensional NEF that are usually treated separately:
Equation (1) is the local bridge between the first two. Theorem 1 shows that this local identity has a global consequence: a fixed sign of standardized skewness is equivalent to a coherent Kullback–Leibler orientation across every pair of distributions in the family. The local assumption in Theorem 1 is particularly noteworthy. One need not compare widely separated distributions. The sign of the asymmetry for sufficiently close symmetric pairs already forces monotonicity of the variance function, which then propagates the direction globally.
Theorem 2 is stronger. Fisher–Rao parametrization removes the local scale variation caused by changing information along the family. In this coordinate, the normalized third-order information is simply . Requiring the amount of Kullback–Leibler non-reversibility to be locally independent of position forces this quantity to be constant. The resulting differential equation for the variance function is elementary once it has been reached, but the substantive point is that it is forced by a purely information-geometric homogeneity condition.
The theorem may be interpreted as a local-to-global rigidity principle. Local translation homogeneity of the directed divergence, local translation homogeneity of its antisymmetric component, local radiality of the magnitude of that asymmetry, and local radiality of Jeffreys divergence all produce the same conclusion. Once constant skewness is obtained, the entire NEF is fixed up to affine equivalence, and the local invariance automatically extends globally.
The normal and gamma families admit a particularly simple interpretation in this framework. Normality corresponds to zero standardized skewness and hence to homogeneous reversible information geometry:
Gamma corresponds to constant nonzero standardized skewness and hence to homogeneous nonreversible information geometry. In both cases, the divergence is translation-homogeneous in Fisher coordinate, but only the normal case is symmetric.
The variance-stabilizing literature gives the Fisher coordinate an additional statistical interpretation. The transformation (5), studied in particular by Bar-Lev and Enis [8,9], was introduced to remove first-order heteroscedasticity. Here, the same transformation removes local Fisher scaling and exposes whether the remaining information asymmetry varies with position. The rigidity theorem therefore identifies precisely those NEFs whose relative-entropy geometry becomes homogeneous after variance stabilization.
The result should also be distinguished from the classical NEF-QVF classification. Morris’s six families [1,2] are characterized by quadratic variance functions. Theorem 2 retains only a constant variance function or the square of an affine function. Thus, quadraticity itself is far too weak. This distinction is reinforced by the recent result of Tojo and Yoshino [21]: constant Hessian sectional curvature leads essentially to the full NEF-QVF class, whereas local KL/Jeffreys homogeneity on the Fisher scale selects only normal and gamma.
There is also a useful contrast with transformation-model invariance. Nielsen and Okamura [19] derive divergence invariance from an assumed group action. In the present setting, no location or scale group is postulated. Instead, intrinsic divergence homogeneity is assumed locally, and the normal-location or gamma-scale structure emerges as a conclusion. Their more recent midpoint-rigidity work [20] is closer in spirit because it links a local geometric invariance condition to constancy of a cubic form, but the invariant, functional equation, and resulting statistical statement are different.
At the time of this revision, the Nielsen–Okamura works cited here remain arXiv preprints, as does the Tojo–Yoshino constant-Hessian-curvature work. The comparisons above are therefore stated only at the level of the specific results currently available in those manuscripts: group-induced divergence invariance, midpoint/constant-cubic-form rigidity, and the equivalence between constant Hessian sectional curvature and the NEF-QVF class, respectively.
Proposition 1 also provides a direct information-theoretic recovery formula for standardized skewness, (11). This is not presented as a replacement for moment-based skewness, but it clarifies the role of skewness geometrically: on the Fisher scale, standardized skewness is exactly the leading infinitesimal coefficient of Kullback–Leibler non-reversibility. Theorem 1 then says that a fixed sign of this coefficient controls global orientation, while Theorem 2 says that constancy of its magnitude and sign is equivalent to full information homogeneity.
Finally, Proposition 2 places the normal family at an equality boundary. The general comparison of Fisher–Rao and Jeffreys–Bregman quantities is known in broader Hessian geometry [22]; within a regular one-dimensional NEF, equality at one distinct pair already implies that the variance function is constant and hence that the family is normal. This equality rigidity is consistent with the broader message of the paper: apparently weak information conditions become highly restrictive once combined with NEF structure.
The scope of the present rigidity theorem is deliberately one-dimensional. In one dimension, Fisher–Rao arc length supplies a canonical scalar coordinate and a signed displacement between nearby models. In higher dimensions, Fisher information is a Riemannian metric, the third-order information object is tensorial, and equal Fisher distance does not by itself specify a direction or a unique comparison path. A multidimensional analogue would therefore require a directional or geodesic formulation of homogeneity rather than a direct replacement of by distance. We do not claim such an extension here. The assumptions of regularity and nondegeneracy are used to ensure a smooth Fisher coordinate, while fullness enters only when the variance-function conclusion is converted into the maximal normal or gamma NEF.
7. Conclusions
This paper has studied two related questions concerning Kullback–Leibler asymmetry in one-dimensional natural exponential families.
The first question concerns orientation. A local Kullback–Leibler ordering for sufficiently close symmetric pairs is equivalent to a fixed sign of standardized skewness and to monotonicity of the variance function. These conditions in turn imply the same direction of Kullback–Leibler divergence for every ordered pair in the family. Thus, a local third-order property determines a global information ordering.
The second question concerns homogeneity. After the family is parametrized by Fisher–Rao arc length, local spatial homogeneity of the directed Kullback–Leibler divergence, of its antisymmetric component, of the magnitude of this asymmetry, or local radiality of Jeffreys divergence are all equivalent. Each condition forces constant standardized skewness. The resulting variance function is either constant or the square of an affine function, and the full NEF is therefore, up to a nonsingular affine transformation, normal or fixed-shape gamma. The local information property then extends automatically to all admissible pairs.
The central structural chain is therefore
In this sense, local information asymmetry determines global NEF structure. The normal family is the homogeneous reversible case and the gamma family is the homogeneous nonreversible case.
Funding
This research received no external funding.
Data Availability Statement
No new data were created or analyzed in this study. Data sharing is not applicable to this article.
Acknowledgments
The author is grateful to the two anonymous reviewers for their careful and critical reading of the manuscript and for their constructive comments and suggestions. Their remarks helped improve both the presentation and the clarity of the paper.
Conflicts of Interest
The author declares no conflict of interest.
References
- Morris, C.N. Natural exponential families with quadratic variance functions. Ann. Stat. 1982, 10, 65–80. [Google Scholar] [CrossRef] [Scilit]
- Morris, C.N. Natural exponential families with quadratic variance functions: Statistical theory. Ann. Stat. 1983, 11, 515–529. [Google Scholar] [CrossRef] [Scilit]
- Letac, G.; Mora, M. Natural real exponential families with cubic variance functions. Ann. Stat. 1990, 18, 1–37. [Google Scholar] [CrossRef] [Scilit]
- Jørgensen, B. The Theory of Dispersion Models; Chapman & Hall: London, UK, 1997. [Google Scholar]
- Bar-Lev, S.K.; Enis, P. Reproducibility and natural exponential families with power variance functions. Ann. Stat. 1986, 14, 1507–1522. [Google Scholar] [CrossRef] [Scilit]
- Bar-Lev, S.K.; Kokonendji, C.C. On the mean value parametrization of natural exponential families—A revisited review. Math. Methods Stat. 2017, 26, 159–175. [Google Scholar] [CrossRef] [Scilit]
- Bar-Lev, S.K. Boundedness of variance functions of natural exponential families with unbounded support. Mathematics 2025, 13, 2045. [Google Scholar] [CrossRef] [Scilit]
- Bar-Lev, S.K.; Enis, P. On the classical choice of variance stabilizing transformations and an application for a Poisson variate. Biometrika 1988, 75, 803–804. [Google Scholar] [CrossRef]
- Bar-Lev, S.K.; Enis, P. On the construction of classes of variance stabilizing transformations. Stat. Probab. Lett. 1990, 10, 95–100. [Google Scholar] [CrossRef] [Scilit]
- Harremoøes, P. Statistical inference and exact saddle point approximations. In Proceedings of the 2018 IEEE International Symposium on Information Theory (ISIT), Vail, CO, USA, 17–22 June 2018; pp. 1395–1399. [Google Scholar] [CrossRef] [Scilit]
- Bar-Lev, S.K. An additional characterization of the triple consisting of normal, gamma, and inverse Gaussian distributions. Mathematics 2026, 14, 2758. [Google Scholar] [CrossRef] [Scilit]
- Kullback, S.; Leibler, R.A. On information and sufficiency. Ann. Math. Stat. 1951, 22, 79–86. [Google Scholar] [CrossRef] [Scilit]
- Efron, B. The geometry of exponential families. Ann. Stat. 1978, 6, 362–376. [Google Scholar] [CrossRef] [Scilit]
- Eguchi, S. Second order efficiency of minimum contrast estimators in a curved exponential family. Ann. Stat. 1983, 11, 793–803. [Google Scholar] [CrossRef] [Scilit]
- Amari, S.; Nagaoka, H. Methods of Information Geometry; American Mathematical Society and Oxford University Press: Providence, RI, USA, 2000. [Google Scholar] [CrossRef] [Scilit]
- Banerjee, A.; Merugu, S.; Dhillon, I.S.; Ghosh, J. Clustering with Bregman divergences. J. Mach. Learn. Res. 2005, 6, 1705–1749. [Google Scholar]
- Eguchi, S.; Copas, J. Interpreting Kullback–Leibler divergence with the Neyman–Pearson lemma. J. Multivar. Anal. 2006, 97, 2034–2040. [Google Scholar] [CrossRef] [Scilit]
- Matúš, F. On limiting towards the boundaries of exponential families. Kybernetika 2015, 51, 725–738. [Google Scholar] [CrossRef] [Scilit][Green Version]
- Nielsen, F.; Okamura, K. Group invariance of f-divergences and the Fisher–Rao distance. arXiv 2026, arXiv:2606.25790. [Google Scholar]
- Nielsen, F.; Okamura, K. Dual-connection midpoint matrix means and their Gauss composition. arXiv 2026, arXiv:2609.07551. [Google Scholar]
- Tojo, K.; Yoshino, T. Equivalence on exponential families as Hessian manifolds and classification of exponential families of order 1 with constant Hessian sectional curvature. arXiv 2026, arXiv:2609.14562. [Google Scholar]
- Nielsen, F. Approximation and bounding techniques for the Fisher–Rao distances between parametric statistical models. In Handbook of Statistics; Elsevier: Amsterdam, The Netherlands, 2024; Volume 51, pp. 67–116. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.