Next Article in Journal
A Suggestion of Converting Protein Intrinsic Disorder to Structural Entropy Using Shannon’s Information Theory
Next Article in Special Issue
Signatures of Quantum Mechanics in Chaotic Systems
Previous Article in Journal
Price Movement Prediction of Cryptocurrencies Using Sentiment Analysis and Machine Learning
Previous Article in Special Issue
Quantum Chaos and Quantum Randomness—Paradigms of Entropy Production on the Smallest Scales
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Majorization and Dynamics of Continuous Distributions

by
Ignacio S. Gomez
1,*,
Bruno G. da Costa
2 and
Maike A. F. dos Santos
3
1
Instituto de Física, Universidade Federal da Bahia, Rua Barao de Jeremoabo, Salvador–BA 40170-115, Brazil
2
Instituto Federal de Educação, Ciência e Tecnologia do Sertão Pernambucano, BR 407, km 08, Petrolina 56314-520, Pernambuco, Brazil
3
Centro Brasileiro de Pesquisas Físicas, Caixa Postal 15051, Rio de Janeiro CEP 91501-970, RJ, Brazil
*
Author to whom correspondence should be addressed.
Entropy 2019, 21(6), 590; https://doi.org/10.3390/e21060590
Submission received: 17 May 2019 / Revised: 10 June 2019 / Accepted: 12 June 2019 / Published: 14 June 2019
(This article belongs to the Special Issue Quantum Chaos and Complexity)

Abstract

:
In this work we show how the concept of majorization in continuous distributions can be employed to characterize mixing, diffusive, and quantum dynamics along with the H-Boltzmann theorem. The key point lies in that the definition of majorization allows choosing a wide range of convex functions ϕ for studying a given dynamics. By choosing appropriate convex functions, mixing dynamics, generalized Fokker–Planck equations, and quantum evolutions are characterized as majorized ordered chains along the time evolution, being the stationary states the infimum elements. Moreover, assuming a dynamics satisfying continuous majorization, the H-Boltzmann theorem is obtained as a special case for ϕ ( x ) = x ln x .

1. Introduction

The concept of majorization has shown a particular interest in the last decades, mainly due to its wide range of applicability in information and quantum theory, among others [1,2,3,4,5,6,7,8,9]. The majorization is an operation between a pair of finite-dimensional vectors that gives a partial order in a finite dimensional vectorial space. When the finite vectors considered are discrete probability distributions, the majorization adopts the intuitive idea that, given two discrete PDFs, the distribution which is majorized represents the probability vector of more spreading of the pair, and consequently it presents the lowest Shannon entropy. Further developments showed an intimately relation between majorization and Schur-convex functions [10,11,12,13,14,15,16], from which subsequent applications in quantum information protocols showed the majorization between two quantum states to be an important criteria to establish [17]. Discrete majorization has also been employed for characterizing double stochastic matrices and maps [18], Boltzmann complexity [19], uncertainty relations [20], and generalized entropies [21], among others.
Based on the majorization of discrete finite-dimensional vectors, Hardy, Littlewood and Pólya introduced the continuous version for integrable functions [22,23], giving as result a characterization of the convex ordering for random variables in the context of order statistics. In general, applications of stochastic orders are established from the viewpoint of the continuous majorization [24,25]. In this sense, both types of majorization, the discrete and the continuous ones, provide different ways to relate the increasing direction of the majorization ordering with the monotonic behavior (increasing or decreasing) of convex functionals defined over probability distributions.
The goal of this paper is to study the relationship between the increasing direction of the majorization ordering and the temporal evolution of a continuous dynamics in order to characterize mixing dynamics, diffusion phenomena and quantum evolutions. Thus, the present contribution also could shed light towards a geometrical definition of the arrow time in the context of continuous majorization.
The work is structured as follows. In Section 2, we review the concept of continuous majorization of integrable functions, along with some properties. Then, in Section 3, we consider a general motion equation for a continuous probability distribution and we establish necessary and sufficient conditions for the set of time-parameterized distributions of a given initial solution, that results to be ordered chain by majorization. We characterize the stationary and the initial states as the infimum and the supreme ones of all ordered chain by continuous majorization, respectively. Section 4 is devoted to illustrate the scope of the formalism presented. First, we consider a continuous dynamical system and we obtain a necessary condition for mixing in terms of majorization. Second, we characterize generalized Fokker–Planck equations (without drift terms) as totally ordered chains (by the time evolution) of probability distributions, and their associated Fisher information are also obtained. Third, quantum evolutions (unitary and non-unitary) are explored from the viewpoint of continuous majorization, and a characterization of the H-theorem in terms of majorization is given. Next, we illustrate some consequences of continuous majorization applied to the Frobenius–Perron operator associated to a model of exponential population dynamics. Finally, in Section 5, some conclusions and perspectives are outlined.

2. Majorization of Integrable Functions and Discrete Vectors

Here, we give the necessary elements for the development of the present work. We begin by recalling the concept of continuous majorization along with some properties.

2.1. Continuous Majorization

We say that a real function f ( x ) is convex (concave, respectively) on a real interval I if for all x , y I we have f ( α x + β y ) α f ( x ) + β f ( y ) (≥, respectively). Consider the set L 1 ( ( 0 , 1 ) ) of all real Lebesgue integrable function on ( 0 , 1 ) and denote by L cx ( I ) the set of all convex functions on I. Given f , g : I R L 1 ( ( 0 , 1 ) ) , it is said that f is majorized by g, denoted by f g , if [22,23,26]
0 1 ϕ ( f ( t ) ) d t 0 1 ϕ ( g ( t ) ) d t , ϕ L cx ( I )
whenever the integrals exist. When L cx ( I ) is substituted by L icx ( I ) (denoting the increasing convex functions on I), the partial order obtained is weak majorization, symbolized by W . It can be seen that ≺ is a reflexive and a transitive relation (i.e., for all f , g , h L 1 ( 0 , 1 ) we have f f and if f g , g h f h ) in L 1 ( 0 , 1 ) . Moreover, ≺ is a partial order since f g and g f do not imply necessarily f = g a.e. If a set of distributions D has two elements g , h such that g f h for all f D , then it is said that g and h are the infimum and the supreme of D , respectively. We say that D is an ordered chain by majorization if for all f , g D we have f g or g f .

2.2. Discrete Majorization

Complementary, Hardy also defined the discrete majorization and showed its relation with the continuous case, as follows. Let x , y R n be two n-dimensional vectors. Then, we say that x y iff
S k : n ( x ) S k : n ( y ) , 1 k n , with S n : n ( x ) = S n : n ( y ) where S k : n ( z ) = i = n + 1 k n z i : n , z R n
Here, z 1 : n z 2 : n z n : n denote the components of z arranged in increasing order. The discrete majorization is a partial order in the set { z R n : z i z i + 1 | i = 1 , , n 1 } since from x y and y x it follows that y is a permutation of x .
Two important concepts that are related to the convexity are the Schur-convexity and the quasi-convexity. A function f : R n R is said to be Schur-convex if for all x , y R n such that x is majorized by y we have f ( x ) f ( y ) . A function f : R n R is quasi-convex if for all a R the preimage of the set ( , a ) is convex. It can be shown that every convex and symmetric function is Schur-convex but the reciprocal is not true, although all Schur-convex functions are symmetric. The relationship between the continuous majorization and the discrete one is described by the following result [22,23,24,25].
Theorem 1. 
Let x , y R n be two n-dimensional vectors and I R an interval. Then, the following propositions are equivalent (see Remark 1.1. of [26]):
(a) 
x is majorized by y .
(b) 
ϕ ( x ) ϕ ( y ) for each Schur-convex function ϕ : I n R .
(c) 
ϕ ( x ) ϕ ( y ) for each symmetric quasi-convex function ϕ : I n R .
(d) 
i = 1 n ϕ ( x i ) i = 1 n ϕ ( y i ) for each convex function g : I R .
Note that ( d ) is the discrete version of the continuous majorization in Equation (1). If necessary, this is the equivalence that we use.

2.3. Probability Distributions and Majorization

When the functions or vectors represent probability distributions, the majorization adopts an intuitive interpretation. To illustrate this, we consider the discrete version and the same argument can be applied to the continuous case.
Let p = ( p 1 , , p n ) and q = ( q 1 , , q n ) be two n-dimensional probability distributions, i.e., p i , q i 0 for all i = 1 , , n and i = 1 n p i = i = 1 n q i = 1 . It is clear that p i , q i 1 for all i = 1 , , n and there exist p k , q l / p k , q l 1 n , thus, by the definition of majorization in Equation (2), we have
( 1 n , , 1 n ) p , q ( 1 , , 0 ) ,
where ( 1 n , , 1 n ) and ( 1 , , 0 ) are the uniform and delta distributions. This means that, considering ≺ as a partial order on the space of n-dimensional probability vectors, the uniform and the delta distributions are the infimum and the supreme elements, respectively.
Physically, if we have an experiment with n possible outcomes x i represented by the space of events Γ = { x 1 , , x n } and p is a probability vector (with p i the probability of that ith outcome occurs) then discrete majorization says that the distribution with the minimal information (the uniform one) is majorized by p , and in turn, p is majorized by the maximal information distribution (the delta one). Here, the expression “maximal (or minimal) information” is understood in the sense of of maximal (minimal) measure of information (typically, the entropy) available by the system in terms of the probability distribution. In the next sections, we exploit this idea for characterizing temporal evolutions of continuous distributions from majorization.

3. Temporal Evolution of Continuous Distributions from Majorization

In this section, we consider a system described by a continuous distribution p ( x , t ) containing its maximal information about the dynamics at time t where x represents a continuous variable in ( 0 , 1 ) . We focus our study on the relationship between the dynamics and majorization (expressed by the Definition (1)) restricted to the set of time-parameterized distributions P = { p t : t 0 } with p t the probability distribution of the system at time t, i.e., p t = p ( x , t ) . Given an arbitrary dynamics, the set P provides the evolution of the system from t = 0 to t = . A first consequence from continuous majorization applied to P = { p t : t 0 } is given by the following Lemma.
Lemma 2. 
The following statements are equivalent:
(I) 
P = { p t : t 0 } is an ordered chain by majorization with p t 2 p t 1 for all t 1 t 2 (i.e., the distribution at time t is majorized by all the precedent ones).
(II) 
The function λ ϕ ( t ) : [ 0 , ] R , λ ϕ ( t ) = 0 1 ϕ ( p t ( x ) ) d x is decreasing in t for all ϕ L cx ( I ) .
In turn, ( I ) or ( I I ) implies that λ ϕ ( t ) = 0 1 ϕ ( p t ( x ) ) ( p t / t ) d x 0 for all t and for all differentiable ϕ L cx ( I ) , and that the initial distribution p 0 is the supreme of P .
Proof. 
( I ) ( I I ) : Let t 1 , t 2 0 be such that t 1 t 2 . Due to the hypothesis ( I ) , we have that p t 2 p t 1 , which, by the continuous majorization definition in Equation (1), implies that 0 1 ϕ ( p t 2 ( s ) ) d s 0 1 ϕ ( p t 1 ( s ) ) d s for all convex function ϕ L c x ( I ) , i.e., λ ϕ ( t 2 ) λ ϕ ( t 1 ) . Hence, λ ϕ ( t ) is decreasing in t.
( I I ) ( I ) : Reciprocally, if λ ϕ ( t ) is decreasing in t, then, for all t 1 t 2 , we have λ ϕ ( t 2 ) λ ϕ ( t 1 ) , which by definition means that 0 1 ϕ ( p t 2 ( s ) ) d s 0 1 ϕ ( p t 1 ( s ) ) d s for all convex function ϕ L c x ( I ) . Then, p t 2 p t 1 and thus the set P = { p t : t 0 } is an ordered chain by majorization.
Finally, let us assume ( I I ) and consider ϕ L c x ( I ) differentiable. Since λ ϕ ( t ) = 0 1 ϕ ( p t ( x ) ) d x is a decreasing function in t, its derivative must be negative for all t, thus λ ϕ ( t ) = 0 1 ϕ ( p t ( x ) ) ( p t / t ) d x 0 . By the equivalence between ( I ) and ( I I ) we have that p t is majorized by all their precedent ones. In particular, it follows that p t p 0 for all t 0 so p 0 is the supreme of P . This completes the proof. □
The content of Lemma 2 is that, when we have a dynamics satisfying ( I ) , it can be characterized by the increasing behavior of the functions λ ϕ ( t ) = 0 1 ϕ ( p t ( x ) ) d x for all convex function ϕ , where the initial distribution majorizes all the subsequent evolved ones. Thus, a first simple connection between dynamics and continuous majorization is provided. We show that the hypothesis ( I ) is compatible with the intuitive idea that, in diffusion phenomena, as the distribution evolves, it tends to spread along its domain (thus approaching to the uniform one that is the infimum element). This is precisely the content of the next result.
Lemma 3. 
Assuming hypothesis ( I ) of Lemma 2 and the existence of an asymptotic probability distribution at t , denoted by p satisfying p / t = 0 , we have
p p t p 0 , t 0
and
λ ϕ ( t ) = 0 , ϕ L cx differentiable
Proof. 
Due to ( I ) , we have p t 2 p t 1 for all t 1 t 2 . By definition, p = lim t p t , from which we obtain p p t for all t 0 . From condition ( I ) of Lemma 2, it follows that p 0 is the supreme of P . Joining these conditions, we obtain p p t p 0 for all t 0 . Now, given that the asymptotic probability distribution p satisfies p / t = 0 , by Lemma 2, for all differentiable ϕ L c x , we have λ ϕ ( t ) = lim t 0 1 ϕ ( p t ( x ) ) ( p t / t ) d x = 0 1 ϕ ( p ( x ) ) ( p / t ) d x = 0 1 ϕ ( p ( x ) ) . 0 d x = 0 . In turn, this implies that λ ϕ ( t ) takes an asymptotic finite value for t for all differentiable ϕ L c x , as physically expected for the stationary probability distribution p . □
When the time evolution preserves majorization in the sense of condition ( I ) , the Lemmas 2 and 3 allow to characterize the dynamics in terms of continuous majorization, where the initial state is the supreme and the stationary one is the infimum. In particular, for the Shannon–Gibbs entropy functional S [ p ] = ψ ( p ( x ) ) d x given by the convex function ψ ( x ) = x ln x , condition ( I I ) says that λ ψ ( t ) is an increasing function of t, thus λ ψ ( t 1 ) λ ψ ( t 2 ) t 1 t 2 , i.e., S [ p t 1 ] S [ p t 2 ] t 1 t 2 , in accordance with the Second Law of thermodynamics.
Next step is to study what kind of phenomena can be compatible with continuous majorization.

4. Applications

To study what type of dynamics can be obtained from continuous majorization, in this section, we illustrate the results with some examples. We begin by discussing the H-Boltzmann theorem. In all the examples, the abstract space X of the variable x is the real interval ( 0 , 1 ) , in order to be compatible with the definition of the continuous majorization in Equation (1).

4.1. H-Theorem and Majorization

We explore the relationship between continuous majorization and one of the pillars of the statistical mechanics: the H-theorem. In 1872, Ludwig Boltzmann introduced a functional H to describe, in an elegant way [27], the approach to equilibrium of a gas composed by colliding molecules in a finite volume with perfectly elastic walls. Let us assume that the gas is sufficiently dilute and that only binary collisions are needed to describe the dynamics. Let p ( r , v , t ) be the distribution function of the molecules such that p ( r , v , t ) d 3 r d 3 v is the number of molecules within a volume d 3 r centered at r with a velocity in a volume d 3 v centered at v . We can also consider that p ( r , v , t ) = p ( r , t ) p ( v ) which physically means the correlations between the positions and the velocities are negligible when the gas is diluted (here, p ( r , t ) and p ( v ) are the marginal distributions with respect the positions and the velocities). Under the SZA (“Stosszahlansatz") hypothesis about the number of collisions for all times, we have that the H-functional
H [ p t ] = p ( r , v , t ) ln p ( r , v , t ) d 3 r d 3 v = p ( r , t ) ln p ( r , t ) d 3 r + constant
satisfies
d H d t 0 ,
where p t = p ( r , t ) and the integration in Equation (6) is over all the positions. The statement of Equation (7) constitutes the Boltzmann’s H-theorem [28] (or simply H-theorem). H-theorem provides a justification to the equilibrium approach and the increasing of the associated entropy H (called “negentropy”, negative of the thermodynamical entropy), and more fundamental, negentropy can be defined by means of Equation (6) for distributions out of the equilibrium. Let us show how the H-theorem can be obtained as a special case of a dynamics satisfying continuous majorization. This is the content of the following result.
Theorem 4. 
If dynamics is preserved by majorization in the sense of condition ( I ) (or equivalently, condition ( I I ) of Lemma 2), then the H-theorem is satisfied.
Proof. 
To compatibilize with Equation (1), we consider that the position space X = { r : r R 3 } is the unidimensional interval ( 0 , 1 ) (the set I = ( 0 , 1 ) of the continuous majorization definition in Equation (1) can be replaced by any subset bounded interval ( a , b ) R and all the definitions and results remain valid, as can be checked straightforwardly). This situation fits with the image of a diluted gas with all its particles contained in a unidimensional box. If condition ( I ) is satisfied for the set P = { p t : t 0 } with p t = p ( x , t ) , then, by Lemma 2, for ϕ 0 ( s ) = s ln s (which is a convex function), we have that λ ϕ 0 ( t ) 0 with λ ϕ 0 ( t ) = H ( t ) . This implies that d H d t 0 for all t 0 . □

4.2. Dynamical Systems: Mixing Property

One of the central concepts of dynamical systems theory and statistical mechanics is the mixing condition [29,30], i.e., the asymptotic vanishing of the correlations between two subsets of phase space that are sufficiently separated in time. In the usual definition in the language of distribution functions, this reads as
f * L 1 ( X ) such that f L 1 ( X ) , g L ( X ) : lim t X f ( T t ( x ) ) g ( x ) d x = X f * ( x ) g ( x ) d x
where X is the phase space, f * is the equilibrium distribution of the system at t ( f * T t = f * ), and T t : X X is a continuous transformation, typically the Liouville time evolution in classical mechanics. In particular, Equation (8) says that the measure μ * ( A ) = A f * ( x ) d x is invariant under T t .
Now, let us assume the dynamics satisfies condition ( I ) of Lemma 2 and X = ( 0 , 1 ) . In particular, for the convex functional ϕ ( x ) = | x | , we have | | f T t | | 1 | | f T t | | 1 for all t t where | | ϕ | | 1 = X | ϕ ( x ) | d x is the 1-norm. It follows that X | ( f T n ) ( x ) g ( x ) | d x | | f T n | | 1 | | g | | | | f T 0 | | 1 | | g | | = | | f | | 1 | | g | | for all n N , where we have used the Hölder–Minkowski inequality [31] and f T 0 = f . Thus, the sequence X ( f T n ) ( x ) g ( x ) d x is bounded and then there exists lim n X ( f T n ) ( x ) g ( x ) d x for all g L . Thus, by application of the Riesz representation theorem [31] to the functional ψ ( g ) : L R defined by ψ ( g ) = lim n X ( f T n ) ( x ) g ( x ) d x , we have that there exists f * L such that ψ ( g ) = f * , g = X f * ( x ) g ( x ) d x for all g L . Hence, the system is mixing. We can see that continuous majorization guarantees that the asymptotic distribution f * belongs to L , which means that this is bounded almost everywhere in the phase space.

4.3. Generalized Fokker–Planck Equations

Disordered and thermal molecular motion is macroscopically characterized as diffusion phenomena of a net flux of particles from one region to other. Under Markovian assumptions and making the passing to the continuum, the discretized master equation for the probability transition states becomes the Fokker–Planck equation (FPE) for the probability distribution. Recently, a generalization of the FPE [32,33,34] (recovering the nonlinear and linear cases as special ones) that links generalized entropic forms with the theorem H is proposed in the form [35,36]
p ( x , t ) t = { F ( x ) Ψ [ p ( x , t ) ] } x + x Ω [ p ( x , t ) ] p ( x , t ) x
where p ( x , t ) is the probability distribution of the particle at time t, F ( x ) = d φ d x is a conservative force acting over the particles, and Ω [ p ] , Ψ [ p ] > 0 are nonnegative functionals. From the functional λ ϕ ( t ) , we can relate majorization with the generalized FPE in Equation (9) as follows. Considering F ( x ) = 0 , we have x d s p ( s , t ) t = Ω [ p ( x , t ) ] p ( x , t ) x with Ω [ p ( x , t ) ] > 0 . Thus, if we integrate by parts the derivative of the function λ ϕ ( t ) (i.e., λ ϕ ( t ) ), we have
λ ϕ ( t ) = ϕ ( p t ( x ) ) x d s p ( s , t ) t 0 1 0 1 ϕ ( p t ( x ) ) p ( x , t ) x x d s p ( s , t ) t d x
where the first term can be neglected since p ( x , t ) x = 0 at x = 0 , 1 . Replacing this in Equation (10) and using that ϕ 0 , we conclude
λ ϕ ( t ) = 0 1 ϕ ( p t ( x ) ) Ω [ p ( x , t ) ] p ( x , t ) x 2 d x 0
for all ϕ L cx ( I ) differentiable. Hence, the generalized FPE in Equation (9) with F ( x ) = 0 satisfies the condition ( I ) of Lemma 2. This means that for F ( x ) = 0 the solutions p t = p ( x , t ) of the generalized FPE in Equation (9) constitute an ordered chain by majorization.

4.4. Quantum Dynamics

We analyze how the continuous majorization can characterize quantum dynamics. We consider that the set P is given by the evolution of the eigenfunctions probability distributions, i.e., P n = { | ψ n ( x , t ) | 2 : t 0 } with n the energy index,
i ψ n t = H ψ n = E n ψ n
and
E n = ϵ n + i γ n
Equation (13) expresses the fact that the Hamiltonian H may be non-Hermitian, for instance in open quantum systems [37]. In the non-Hermitian case, the measurable eigenergies of the system are the ϵ n while the | γ n | 2 are proportional to the decay times. It is clear that the usual unitary case is recovered when γ n = 0 for all n. To verify if the dynamics prescribed by Equation (12) preserves majorization according to condition ( I ) of Lemma 2, we calculate the derivate of the function λ ψ n ( t ) for each energy index n. Doing this and using that d ψ n d t ψ n * + d ψ n * d t ψ n = 2 γ n | ψ n | 2 , we obtain
λ ϕ ( t ) = 2 γ n 0 1 ϕ ( | ψ n | 2 ) | ψ n | 2 d x , ϕ L cx ( I ) diff
where the domain of the variable x of the eigenfunctions ψ n ( x , t ) is assumed to be ( 0 , 1 ) . Equation (14) is the starting point for characterizing some types of quantum dynamics in terms of majorization.
Case I: Hermitian dynamics γ n = 0 n : From Equation (14), we can see that λ ϕ ( t ) = 0 for all ψ n , thus λ ϕ ( t ) is constant for all t, which implies that, for all ψ n ( x , t 1 ) , ψ n ( x , t 2 ) and t 1 , t 2 , we have that | ψ n ( x , t 1 ) | 2 | ψ n ( x , t 2 ) | 2 and | ψ n ( x , t 2 ) | 2 | ψ n ( x , t 1 ) | 2 . This means that the infimum and the maximum are always the same | ψ n ( x , t ) | 2 (with t 0 arbitrary) along time. In other words, in a unitary dynamics, the the order relation of the continuous majorization becomes the trivial one.
Case II: Non-Hermitian dynamics γ j 0 for some j: Given ϕ L cx ( I ) differentiable, since ϕ is convex, ϕ is nonnegative, which implies that ϕ is increasing. In particular, from | ψ n ( x , t ) | 2 0 , it follows that ϕ ( | ψ n | 2 ) ϕ ( 0 ) . Assuming γ j < 0 for some j, we obtain
λ ϕ ( t ) 2 γ j ϕ ( 0 ) , ϕ L cx ( I ) differentiable
In this case, we see that, to fulfill condition ( I ) , we need ϕ ( 0 ) 0 ( ϕ ( 0 ) 0 if γ j > 0 , respectively) for all ϕ L cx ( I ) , which can be satisfied if ϕ L icx ( I ) , thus leading to a weak majorization. Hence, for the case of a non-Hermitian dynamics, we have that P j = { | ψ j ( x , t ) | 2 : t 0 } is a ordered chain by weak majorization when γ j < 0 .

4.5. Population Dynamics: Exponential Model and Majorization

Now, we show an application of continuous majorization to the exponential model of population dynamics. This model is given by the discrete map
N k + 1 = λ N k , k = 0 , 1 ,
where N k is the number of individuals of the population at a discrete time k, N 0 represents the initial population, and the parameter λ 0 defines the population growth rate. The dynamics is completely characterized by four regimes:
λ = 1
Since N k = N 0 for all k, the population remains the same along time.
λ < 1
The number of individuals decreases in each time step so it tends to zero for large times.
λ > 1
The number of individuals is growing in such a way that it tends to infinity asymptotically.
λ = 0
This case correspond to the extinction of the population since N k = 0 for all time k.
Beyond the simplicity of the exponential model, it is instructive to investigate a characterization from the viewpoint of the continuous majorization. Thus, we are interested in studying the dynamics by means of probability densities instead of trajectories ( N 0 , N 1 , , N k , ) . This is according with the more realistic situation where the exact number of individuals at a given time is unknown and only known to be distributed over a range of values. If ρ 0 ( x ) represents mathematically how the initial population is distributed and x is the initial number of individuals, then we can analyze the dynamics in terms of continuous majorization by means of the transfer operator. In the following, we employ some definitions and concepts presented in Chapter 3 of the book by Mackey and Lasota [38].
Given a discrete map x k + 1 = f ( x k ) with f : X X and X the variable space of the map (typically, a subset of the real numbers), the transfer operator P associated (Frobenius–Perron operator, equivalently) is defined as (see Equation (3.2.2) of [38])
A P ρ ( x ) d x = f 1 ( A ) ρ ( x ) d x
for all continuous probability distribution ρ ( x ) : X R and subset A X , being f 1 ( A ) the preimage of A. The Frobenius–Perron operator P belongs to the class of Markov operators, which is a relevant family of operators in dynamical systems theory since they allow to define the evolution of distributions functions on abstract spaces.
For unidimensional maps and when f is a differentiable and bijective function, given a probability distribution ρ : X R , the Frobenius–Perron admits the following expression (see Equation (3.2.7) of [38])
P ρ ( x ) = ρ ( f 1 ( x ) ) d d x f 1 ( x )
For the case of the exponential model, from Equation (16), we have f ( x ) = λ x and f 1 ( x ) = λ 1 x . Then, the associated Frobenius–Perron operator takes the form
P ρ ( x ) = λ 1 ρ ( λ 1 x )
Let us show that the Frobenius operator in Equation (19) generates a dynamics that preserves continuous majorization in Equation (1) for all initial distribution. Let ϕ : R R be a convex function with ϕ ( 0 ) = 0 . Due to the convexity, for all 0 < α 1 , we have
α 1 ϕ ( α y ) ϕ ( y ) α ϕ ( α 1 y )
for all y R . Since λ = 0 and λ = 1 correspond to the two trivial stationary cases, it is sufficient to only consider 0 < λ < 1 and λ > 1 . Let g ( x ) be a probability distribution defined on an interval [ a , b ] . Then, by Equation (19), the evolved probability distribution P g is defined over [ f ( a ) , f ( b ) ] . Here, we also consider the possibility that the interval of integration I in the definition of the continuous majorization in Equation (1) can be the set of real numbers, i.e., I = R , which is according to the Definition 2.6. of [39].
We begin by 0 < λ < 1 ̲ : Taking y = g ( λ 1 x ) and α = λ , from Equation (19) and using the right side of the inequalities in Equation (20), it follows that
λ 1 ϕ ( g ( λ 1 x ) ) ϕ ( λ 1 g ( λ 1 x ) ) = ϕ ( P g ( x ) ) ;
then, by integrating Equation (21) between f ( a ) = λ a and f ( b ) = λ b , we obtain
I ϕ ( g ( s ) ) d s = a b ϕ ( g ( s ) ) d s = λ a λ b λ 1 ϕ ( g ( λ 1 x ) ) d x f ( a ) f ( b ) ϕ ( P g ( s ) ) d s = I ϕ ( P g ( s ) ) d s ,
which shows that g is majorized (with [ a , b ] , [ f ( a ) , f ( b ) ] I = R and g , P g naturally extended over R as being zero outside their respective domains) by P g , i.e., g P g . In turn, this can be interpreted as the probability distribution P g is less spread than g. This means that, when the growth of the rate is higher than 1, any initial probability distribution g results less widespread along its domain as it evolves, and therefore a localization around some region of the domain takes place.
Case λ > 1 ̲ : Now, we consider y = g ( λ 1 x ) and α = λ 1 . Then, from Equation (19) and the left side of the inequalities in Equation (20), we have
ϕ ( P g ( x ) ) = ϕ ( λ 1 g ( λ 1 x ) ) λ 1 ϕ ( g ( λ 1 x ) )
thus, integrating both sides of Equation (23) between f ( a ) = λ a and f ( b ) = λ b , we obtain the inequality in Equation (22) but in the opposite order, i.e.,
I ϕ ( P g ( s ) ) d s = f ( a ) f ( b ) ϕ ( P g ( s ) ) d s a b ϕ ( g ( s ) ) d s = I ϕ ( g ( s ) ) d s .
This means that, when λ > 1 , according to Equation (1), g majorizes P g ( P g g ) and then any initial probability distribution g spreads along its evolution, thus showing a diffusive behavior as the time increases. Thereby, the characterization of the Frobenius–Perron operator in Equation (19) associated to the map in Equation (16) in terms of continuous majorization allows obtaining features of the dynamics without performing any explicit calculus but providing general conditions.
Let us illustrate the localized ( 0 < λ < 1 ) and diffusive ( λ > 1 ) behaviors of the probability distributions when the evolution is given by the Frobenius–Perron operator in Equation (19) with a concrete example. We consider that our ignorance about the initial population is given by a uniform distribution ρ 0 ( x ) = 1 [ 0 , 1 ] ( x ) along the interval [ 0 , 1 ] . Here, the dimensionless variable x represents the fraction of individuals with respect to a maximum allowed number of individuals M. We denote P n ρ 0 ( x ) = P n times P ρ 0 ( x ) as ρ n ( x ) , which represents the probability distribution of the population after n time steps. Using Equation (19), we obtain
ρ n ( x ) = P n ρ 0 ( x ) = 1 λ n 1 [ 0 , λ n ] ( x )
which expresses different behaviors depending on the value of the growth rate λ . For instance, when λ = 1 , the initial population distribution remains the same P n 1 [ 0 , 1 ] ( x ) = 1 [ 0 , 1 ] ( x ) for all time n.
In Figure 1, we illustrate the two relevant regimes ( 0 < λ < 1 and λ > 1 ) in terms of the probability distribution ρ n for n = 0 , 1 , 2 , 3 , 4 and for some the representative values of λ = 2 , 1 / 2 . We can see the fast diffusion or localization (around x = 0 , i.e., population extinction) of the the probability distribution ρ 0 , previously characterized by means of majorization.

5. Conclusions

By considering the concept of continuous majorization in ordered chains, whose elements are continuous distributions representing solutions of physical equations, in this paper, we have explored some relationships that illustrate the role played by continuous majorization in different contexts. We have obtained simple results (Lemmas 2 and 3) that allow characterizing the dynamics towards the equilibrium for all system whose states are represented by probability distributions, where the temporal order can be expressed univocally as a majorization order, in which, as the distribution evolves along the time, it is majorized by its corresponding earlier times. As a result of this characterization, the equilibrium distribution and the initial one correspond to the minimum and maximal elements, respectively.
After this characterization of a continuous dynamics by means of continuous majorization, we have analyzed some different examples. Specifically, under the assumption of a dynamics satisfying continuous majorization (condition ( I ) of Lemma 2), the H-theorem has been obtained as a special case by choosing the convex function ϕ ( x ) = x ln x (Theorem 4). Analogously, the mixing property in dynamical systems has been obtained by assuming a dynamics satisfying condition ( I ) and choosing ϕ ( x ) = | x | . For the case of the Curado–Nobre generalized FPE in absence of forces, we have shown that the set of solutions indexed by the time constitutes an ordered chain by continuous majorization. Last, we have explored the quantum dynamics generated by the probability distributions given by the eigenfunctions in terms of continuous majorization. In this case, we have found that the Hermitian (unitary) case corresponds to the trivial order while the non-Hermitian (non-unitary) case gives a non-trivial order.
In summary, our contribution is two-fold. On the one hand, Lemmas 2 and 3 provide a general framework for majorization in a continuous dynamics that can be exported in specific contexts, as illustrated in Section 4. On the other hand, the linking between continuous majorization and the H-theorem by means of Theorem 4 could serve to shed light on the question of the thermodynamical arrow of time. In this sense, we can see that the continuous majorization contains a proper arrow of time governed by its induced order in a continuous dynamics. It is worth noting that the continuous majorization removes some relevance of the thermodynamical entropy as the main functional to be considered; for instance, in the context of dynamical systems, we have seen that the convex function to obtain the mixing property corresponds to the module function. This kind of flexibility by means of the choice of the convex function ϕ is schematized in Figure 2. After this, we have also provided an example with a simple model of exponential population dynamics. In this example, the concept of continuous majorization applied to the Frobenius–Perron allowed us to characterize the relevant regimes of the population dynamics by obtaining general conditions (diffusion and localization), which were subsequently illustrated (Figure 1).
Finally, an examination of these consequences with more examples is expected in future contexts (for instance, in fractional nonlinear systems [40], quantifying chaos [41], integro-differential equations [42], etc.) in order to establish with more details the role of continuous majorization on the foundations of the physics.

Author Contributions

All authors contributed equally. All authors have read and approved the final manuscript.

Funding

I. S. Gomez acknowledges support received from the National Institute of Science and Technology for Complex Systems (INCT-SC), and from CAPES/INCT-SC (at Universidade Federal da Bahia), Brazil. B. G. da Costa is grateful to Instituto Federal de Educação, Ciência e Tecnologia do Sertão Pernamubucano, Petrolina, Brazil. M. A. K. dos Santos acknowledges support received from CAPES/INCT-SC (at Centro Brasileiro de Pesquisas Físicas), Brazil.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chang, C.S. A new ordering for stochastic majorization: Theory and applications. Adv. Appl. Probab. 1992, 24, 604–634. [Google Scholar] [CrossRef]
  2. Mairal, J. Incremental majorization-minimization optimization with application to large-scale machine learning. SIAM J. Optim. 2015, 25, 829–855. [Google Scholar] [CrossRef]
  3. Bekhti, Y.; Lucka, F.; Salmon, J.; Gramfort, A. A hierarchical Bayesian perspective on majorization-minimization for non-convex sparse regression: Application to M/EEG source imaging. Inverse Probl. 2018, 34, 085010. [Google Scholar] [CrossRef]
  4. Bashkar, E.; Torabi, H.; Dolati, A.; Belzunce, F. f-Majorization with Applications to Stochastic Comparison of Extreme Order Statistics. J. Stat. Theory Appl. 2018, 17, 520–536. [Google Scholar] [CrossRef]
  5. Korzekwa, K.; Chubb, C.T.; Tomamichel, M. Avoiding irreversibility: Engineering resonant conversions of quantum resources. Phys. Rev. Lett. 2019, 122, 110403. [Google Scholar] [CrossRef] [PubMed]
  6. Arnold, B.C. Majorization and the Lorenz Order: A Brief Introduction; Springer Science & Business Media: Berlin, Germany, 2012; Volume 43. [Google Scholar]
  7. Tong, Y. Some recent developments on majorization inequalities in probability and statistics. Linear Algebra Appl. 1994, 199, 69–90. [Google Scholar] [CrossRef] [Green Version]
  8. Khan, M.A. Majorization theorem for convexifiable functions. Math. Commun. 2013, 18, 61–65. [Google Scholar]
  9. Palacios, J.L. Some inequalities for Laplacian descriptors via majorization. MATCH Commun. Math. Comput. Chem. 2017, 77, 189–194. [Google Scholar]
  10. Meilijson, I.; Nádas, A. Convex majorization with an application to the length of critical paths. J. Appl. Probab. 1979, 16, 671–677. [Google Scholar] [CrossRef]
  11. Noor, M.A.; Noor, K.I.; Awan, M.U. Quantum Integral Inequalities for Generalized Convex Functions. In Progress in Approximation Theory and Applicable Complex Analysis; Springer: Berlin, Germany, 2017; pp. 219–235. [Google Scholar]
  12. Kreutz-Delgado, K.; Rao, B.D.; Engan, K.; Lee, T.W.; Sejnowski, T. Convex/schur-convex (csc) log-priors and sparse coding. In 6th Joint Symposium on Neural Computation; Institute for Neural Computation: San Diego, CA, USA, 1999; Volume 9, pp. 65–71. [Google Scholar]
  13. Niezgoda, M. Vector majorization and Schur-concavity of some sums generated by the Jensen and Jensen-Mercer functionals. Math. Inequal. Appl. 2015, 18, 769–786. [Google Scholar] [CrossRef]
  14. Shi, H.N.; Zhang, J. Compositions involving Schur harmonically convex functions. J. Comput. Anal. Appl. 2017, 22, 907–922. [Google Scholar]
  15. Rudnicki, Ł.; Puchała, Z.; Życzkowski, K. Strong majorization entropic uncertainty relations. Phys. Rev. A 2014, 89, 052115. [Google Scholar] [CrossRef]
  16. Proschan, F.; Sethuraman, J. Schur functions in statistics i. the preservation theorem. Ann. Stat. 1977, 5, 256–262. [Google Scholar] [CrossRef]
  17. Nielsen, M.A. An Introduction to Majorization and Its Applications to Quantum Mechanics; Lecture Notes; Department of Physics, University of Queensland: Brisbane, QLD, Australia, 2002. [Google Scholar]
  18. Ando, T. Majorization, Doubly Stochastic Matrices, and Comparison of Eigenvalues. Linear Algebra Appl. 1980, 118, 163–248. [Google Scholar] [CrossRef]
  19. Seitz, W.; Kirwan, A.D. Boltzmann Complexity: An Emergent Property of the Majorization Partial Order. Entropy 2016, 18, 347. [Google Scholar] [CrossRef]
  20. Baek, K.; Nha, H.; Wonmin, S. Entropic Uncertainty Relations via Direct-Sum Majorization Relation for Generalized Measurements. Entropy 2019, 21, 270. [Google Scholar] [CrossRef]
  21. Holik, F.; Bosyk, G.M.; Guido, B. Quantum Information as a Non-Kolmogorovian Generalization of Shannon’s Theory. Entropy 2015, 17, 7349–7373. [Google Scholar] [CrossRef]
  22. Hardy, G.H. Some simple inequalities satisfied by convex functions. Messenger Math. 1929, 58, 145–152. [Google Scholar]
  23. Hardy, G.H.; Littlewood, J.E.; Pólya, G. Inequalities; University Press: Edinburgh, UK, 1952. [Google Scholar]
  24. Marshall, A.W.; Olkin, I.; Arnold, B.C. Inequalities: Theory of Majorization and Its Applications; Springer: Berlin, Germany, 1979; Volume 143. [Google Scholar]
  25. Niculescu, C.P.; Persson, L.E. Special Topics in Majorization Theory. In Convex Functions and Their Applications; Springer: Berlin, Germany, 2018; pp. 301–326. [Google Scholar]
  26. De la Cal, J.; Cárcamo, J. Stochastic orders and majorization of mean order statistics. J. Appl. Probab. 2006, 43, 704–712. [Google Scholar] [CrossRef]
  27. Cercignani, C. The boltzmann equation. In The Boltzmann Equation and Its Applications; Springer: Berlin, Germany, 1988; pp. 40–103. [Google Scholar]
  28. Brown, H.R.; Myrvold, W.; Uffink, J. Boltzmann’s H-theorem, its discontents, and the birth of statistical mechanics. Stud. Hist. Philos. Sci. Part B Stud. Hist. Philos. Mod. Phys. 2009, 40, 174–191. [Google Scholar] [CrossRef]
  29. Gomez, I.; Castagnino, M. A Quantum Version of Spectral Decomposition Theorem of dynamical systems, quantum chaos hierarchy: Ergodic, mixing and exact. Chaos Solitons Fractals 2015, 70, 99–116. [Google Scholar] [CrossRef]
  30. Casati, G.; Prosen, T. Mixing property of triangular billiards. Phys. Rev. Lett. 1999, 83, 4729. [Google Scholar] [CrossRef]
  31. Brezis, H. Functional Analysis, Sobolev Spaces and Partial Differential Equations; Springer: New York, NY, USA, 2010; pp. 92–97. [Google Scholar]
  32. Chavanis, P.H. Nonlinear mean field Fokker-Planck equations. Application to the chemotaxis of biological populations. Eur. Phys. J. B 2008, 62, 179–208. [Google Scholar] [CrossRef] [Green Version]
  33. Curado, E.; Nobre, F. Equilibrium States in Two-Temperature Systems. Entropy 2018, 20, 183. [Google Scholar] [CrossRef]
  34. Dos Santos, M.A.F.; Lenzi, E.K. Entropic nonadditivity, H theorem, and nonlinear Klein-Kramers equations. Phys. Rev. E 2017, 96, 052109. [Google Scholar] [CrossRef] [PubMed]
  35. Schwämmle, V.; Nobre, F.D.; Curado, E.M. Consequences of the H theorem from nonlinear Fokker-Planck equations. Phys. Rev. E 2007, 76, 041123. [Google Scholar] [CrossRef] [PubMed]
  36. Schwämmle, V.; Curado, E.M.; Nobre, F.D. A general nonlinear Fokker-Planck equation and its associated entropy. Eur. Phys. J. B 2007, 58, 159–165. [Google Scholar] [CrossRef]
  37. Moiseyev, N. Non-Hermitian Quantum Mechanics; Cambridge University Press: Cambridge, UK, 2011. [Google Scholar]
  38. Lasota, A.; Mackey, M. Probabilistic Properties of Deterministic Systems; Cambridge University Press: Cambridge, UK, 1985; Volume 43. [Google Scholar]
  39. Joe, H. Majorization and Divergence. J. Math. Anal. Appl. 1990, 148, 287–305. [Google Scholar] [CrossRef]
  40. Sene, N. Lyapunov Characterization of the Fractional Nonlinear Systems with Exogenous Input. Entropy 2018, 2, 17. [Google Scholar] [CrossRef]
  41. Awrejcewicz, J.; Krysko, A.V.; Erofeev, N.; Dobriyan, V.; Barulina, M.A.; Krysko, V.A. Quantyfying chaos by various computational methods. Part 1: Vibrations of the Bernoulli-Euler beam subjected to periodic and colored noise. Entropy 2018, 20, 170. [Google Scholar] [CrossRef]
  42. Valdes, J.N. A note on the boundedness of an integro-differential equation. Quaest. Math. 2001, 24, 213–216. [Google Scholar] [CrossRef]
Figure 1. Evolved probability distributions ρ n ( x ) given by the Equation (25) for λ = 2 and λ = 1 / 2 , respectively. The arrow indicates the temporal evolution. The diffusive regime represents an increasing of the ignorance about the population and the majorization ordering in Equation (1) is opposite to the temporal one (arrow). By contrast, when localization occurs, the population rapidly concentrates around x = 0 , which expresses the extinction of the population, and the majorization ordering coincides with the temporal evolution.
Figure 1. Evolved probability distributions ρ n ( x ) given by the Equation (25) for λ = 2 and λ = 1 / 2 , respectively. The arrow indicates the temporal evolution. The diffusive regime represents an increasing of the ignorance about the population and the majorization ordering in Equation (1) is opposite to the temporal one (arrow). By contrast, when localization occurs, the population rapidly concentrates around x = 0 , which expresses the extinction of the population, and the majorization ordering coincides with the temporal evolution.
Entropy 21 00590 g001
Figure 2. Some necessary and sufficient conditions for continuous majorization in different contexts illustrate the relevance of the concept of majorization in a continuous dynamics.
Figure 2. Some necessary and sufficient conditions for continuous majorization in different contexts illustrate the relevance of the concept of majorization in a continuous dynamics.
Entropy 21 00590 g002

Share and Cite

MDPI and ACS Style

Gomez, I.S.; da Costa, B.G.; dos Santos, M.A.F. Majorization and Dynamics of Continuous Distributions. Entropy 2019, 21, 590. https://doi.org/10.3390/e21060590

AMA Style

Gomez IS, da Costa BG, dos Santos MAF. Majorization and Dynamics of Continuous Distributions. Entropy. 2019; 21(6):590. https://doi.org/10.3390/e21060590

Chicago/Turabian Style

Gomez, Ignacio S., Bruno G. da Costa, and Maike A. F. dos Santos. 2019. "Majorization and Dynamics of Continuous Distributions" Entropy 21, no. 6: 590. https://doi.org/10.3390/e21060590

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop