Next Article in Journal
Thermal Optimization of a Dual Pressure Goswami Cycle for Low Grade Thermal Sources
Previous Article in Journal
A Peak Traffic Congestion Prediction Method Based on Bus Driving Time
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

On MV-Algebraic Versions of the Strong Law of Large Numbers

Systems Research Institute, Polish Academy of Sciences, Newelska 6, 01-447 Warsaw, Poland
*
Author to whom correspondence should be addressed.
Entropy 2019, 21(7), 710; https://doi.org/10.3390/e21070710
Submission received: 24 May 2019 / Revised: 4 July 2019 / Accepted: 16 July 2019 / Published: 19 July 2019
(This article belongs to the Section Information Theory, Probability and Statistics)

Abstract

:
Many-valued (MV; the many-valued logics considered by Łukasiewicz)-algebras are algebraic systems that generalize Boolean algebras. The MV-algebraic probability theory involves the notions of the state and observable, which abstract the probability measure and the random variable, both considered in the Kolmogorov probability theory. Within the MV-algebraic probability theory, many important theorems (such as various versions of the central limit theorem or the individual ergodic theorem) have been recently studied and proven. In particular, the counterpart of the Kolmogorov strong law of large numbers (SLLN) for sequences of independent observables has been considered. In this paper, we prove generalized MV-algebraic versions of the SLLN, i.e., counterparts of the Marcinkiewicz–Zygmund and Brunk–Prokhorov SLLN for independent observables, as well as the Korchevsky SLLN, where the independence of observables is not assumed. To this end, we apply the classical probability theory and some measure-theoretic methods. We also analyze examples of applications of the proven theorems. Our results open new directions of development of the MV-algebraic probability theory. They can also be applied to the problem of entropy estimation.

1. Introduction

MV-algebras, being generalizations of Boolean algebras, were introduced by Chang [1] and used in the analysis of many-valued logic. Since this time, the theory of MV-algebras (see [2] and the references therein) has been considerably developed. The role of MV-algebras in the theory of quantum structures was discussed in [3,4].
Carathéodory defined the basic notions of point-free probability, replacing Kolmogorovian probability measures on σ -algebras by strictly positive probability measures on σ -complete Boolean algebras and random variables, defined within the Kolmogorov probability theory as measurable functions on the event space Ω , by functions from the σ -algebra of Borel subsets of R into the σ -Boolean algebra of events (see, e.g., [5]). The MV-algebraic probability theory generalizes the Boolean theory of probability, built by Carathéodory and von Neumann. In this paper, we assume that a state m : M [ 0 , 1 ] on an MV-algebra M is a normalized σ -additive functional. Therefore, for each observable x : B R M , the function m x : B R 0 , 1 of the form m x A = m x A , A B R , is a probability measure. Another notion of a state, which is not considered in this paper, was introduced by Mundici [6] as a normalized additive functional s : M [ 0 , 1 ] . The σ -additivity of such a functional is obtained via the Kroupa–Panti theorem (see, e.g., Mundici [7]) and Riesz representation.
Main theorems of the MV-algebraic probability theory, including the basic version of the central limit theorem (CLT), laws of large numbers, and the individual ergodic theorem, can be found in [4,8,9]. In the MV-algebraic setting, there exist three versions of the SLLN (see [4,8]). The first one concerns the convergence of an independent sequence { x i } i N of square-integrable observables in a probability MV-algebra M , m , satisfying the Kolmogorov condition (K): i = 1 σ 2 ( x i ) i 2 < , where σ 2 ( x i ) is the variance of x i , i N . The analogous version of the SLLN was proven for a strongly independent sequence { x i } i N of square-integrable weak observables, satisfying (K). The third MV-algebraic version of the strong law of large numbers concerns the convergence of a ⊙-independent sequence { x i } i N of square-integrable weak observables, satisfying (K), under the additional assumption that the considered MV-algebra M is weakly σ -distributive. Generalized versions of the MV-algebraic central limit theorem, i.e., the Lindeberg and Lyapunov CLT, as well as the Feller theorem were proven by Nowak and Hryniewicz [10]. It is important to underline that, similar to in the Kolmogorov probability theory, the MV-algebraic versions of central limit theorem and strong law of large numbers are different types of theorems, since they concern different types of convergence of scaled sums of observables, i.e., the convergence in distribution in the first case and the convergence m-almost everywhere in the second case.
The MV-algebraic probability theory was also applied in the Atanassov intuitionistic fuzzy sets and interval-valued fuzzy sets settings (see, e.g., [11,12,13,14,15,16,17,18]). The notion of probability for the Atanassov intuitionistic fuzzy sets was introduced by Szmidt and Kacprzyk [19]. Some interesting aspects of the MV-algebraic probability theory were also studied in [20,21,22,23], etc.
As we have mentioned before, Riečan proved the MV-algebraic version of the SLLN for independent observables satisfying the Kolmogorov condition. This is a counterpart of the classical Kolmogorov theorem for independent square-integrable random variables, which is important for the Kolmogorov probability theory. However, in many practical problems, its assumptions are not satisfied, e.g., in the case where the second moments of the random variables do not exist or the random variables are dependent. In such situations, other strong laws of large numbers, including the Marcinkiewicz–Zygmund, Brunk–Prokhorov, and Korchevsky SLLN, are effective tools. In this paper, we prove generalized versions of the SLLN, i.e., the Marcinkiewicz–Zygmund, Brunk–Prokhorov, and Korchevsky SLLN, within the MV-algebraic probability theory, applying their classical counterparts and some measure-theoretic methods. The first two theorems, which were also proven by the authors in a non-MV-algebraic interval-valued fuzzy sets setting (see [24]), are devoted to sequences of independent observables in a probability MV-algebra, whereas the last one concerns observables taking values in a probability MV-algebra with the product, and their independence is not required. Since the above-mentioned classical versions of the SLLN are very useful from the theoretical point of view, we believe that their MV-algebraic counterparts will contribute to further development of the MV-algebraic probability theory, including the theory of stochastic processes in the MV-algebraic setting, and will be very useful for its applications to estimation methods.
We present three examples of the applications of the Marcinkiewicz–Zygmund, Brunk–Prokhorov, and Korchevsky SLLN for sequences of observables with convergent scaled sums. In particular, independent identically continuously distributed, as well as both independent and dependent discretely-distributed observables are considered.
The problem of entropy estimation is important from both theoretical and practical points of view. Classical versions of the law of large numbers are used in this field. In particular, the authors of [25,26,27] applied the SLLN to the analysis of the estimation of information theoretic measures, including entropy and Kullback–Leibler divergence. On the other hand, in [28], the concept of logical entropy was studied in the case of the family of IF-events, which can be embedded into a suitable MV-algebra. The results obtained in this paper are treated by us as tools to introduce methods of estimation of logical entropy, as well as other types of entropy in the case mentioned above.
The paper is organized as follows. Section 2 contains notations and selected elements of the MV-algebraic probability theory. The main results are presented in Section 3. The MV-algebraic versions of the Marcinkiewicz–Zygmund, Brunk–Prokhorov, and Korchevsky SLLN are proven there. Examples of applications of the SLLNs are discussed in Section 4. The paper is concluded in Section 5.

2. Preliminaries

We present some notations that are used in the paper.
We denote by R and N the set of real numbers and positive integers, respectively. For n N , the symbol B ( R n ) denotes the σ -algebra of Borel subsets of R n .
Let X , X and X , X be two measurable spaces. A mapping T : X X is measurable X / X if T 1 A X for each A X .
For each real-valued random variable X on a probability space Ω , S , P , we denote by E X the expected value of X and by E | X | p (for p > 0 ) the absolute p th moment of X with respect to P (if they exist).

Selected Elements of the MV-Algebraic Probability Theory

The foundations of the theory of MV-algebras can be found in [2]. In this section, we recall only basic definitions and facts concerning MV-algebras and the MV-algebraic probability theory based on [4,10].
Definition 1.
An MV-algebra M , 0 , 1 , ¬ , , is an algebra, where M is a non-empty set, the operation is associative and commutative with zero as the neutral element, ¬ 0 = 1 , ¬ 1 = 0 , and for each x , y M :
x 1 = 1 , y ¬ y ¬ x = x ¬ x ¬ y , x y = ¬ ¬ x ¬ y .
In an MV-algebra M , 0 , 1 , ¬ , , , a partial order is defined by the relation:
x y x ¬ y = 0 , x , y M .
The underlying lattice of M is the distributive lattice M , , with the least element zero and the greatest element one, where the join and the meet are defined as follows: x y = ¬ ¬ x y y ; x y = ¬ ¬ x ¬ y for each x , y M .
Definition 2.
An MV-algebra M is called σ-complete (complete) if every sequence (non-empty set, respectively) of elements of M has the supremum in M.
For a non-empty set X and an MV-algebra M, we introduce the notations:
  • for A n n = 1 2 X A n A iff A 1 A 2 and n A n = A ,
  • for x n n = 1 R x n x iff x 1 x 2 and x = sup i x i ,
  • for b n n = 1 M b n b iff b 1 b 2 and b = sup i b i .
Definition 3.
Given a σ-complete MV-algebra M, a function m : M 0 , 1 is called a state on M if it satisfies the following conditions for each a , b , c M and a n n = 1 M :
(i) 
m 1 = 1 ;
(ii) 
if b c = 0 , then m b c = m b + m c ;
(iii) 
if a n a , then m a n m a .
A state m on M is called faithful if m x 0 for each non-zero element x of M.
Definition 4.
A probability MV-algebra is a pair M , m consisting of a σ-complete MV-algebra M and a faithful state m on M.
If M , m is a probability MV-algebra, then M is complete (see Theorem 13.8 in [7]).
Definition 5.
Given a σ-complete MV-algebra M, a function x : B R n M is called an n-dimensional observable in M if it satisfies the following conditions:
(i) 
x R n = 1 ;
(ii) 
x A x B = 0 and x A B = x A x B for each A , B B R n such that A B = ;
(iii) 
for each A , A 1 , A 2 , B R n if A n A , then x A n x A .
Theorem 1.
Given M a σ-complete MV-algebra, an n-dimensional observable x : B R n M , and a state m on M, the function m x : B R n 0 , 1 described by:
m x A = m x A = m x A , A B R n ,
is a probability measure on B R n .
The proof of the above theorem can be found in [10].
Definition 6.
Let M , m be a probability MV-algebra. We call an observable x : B R M integrable in M , m if the expectation E x = R t d m x t exists. Moreover, we write x L m p for p > 0 if E | x | p = R | t | p d m x t < , where E | x | p is the absolute p th moment of x. If x L m 2 , then the variance of x is given by the formula D 2 x = E x 2 E x 2 .
Definition 7.
Observables x 1 , x 2 , , x n in a probability MV-algebra M , m are said to be independent (with respect to m) if there exists an n-dimensional observable h : B R n M (called the joint observable of x 1 , x 2 , , x n ) such that for arbitrary C 1 , C 2 , , C n B R :
m h C 1 × C 2 × × C n = m x 1 C 1 m x 2 C 2 m x n C n .
Remark 1.
Let x 1 , x 2 , , x n : B R M be independent observables in a probability MV-algebra M , m and h n : B R n M be their joint observable. Then, for arbitrary Borel measurable function g n : R n R , the mapping given by:
g n x 1 , x 2 , , x n = h n g n 1
is an observable.
Convergence almost everywhere of observables in a probability MV-algebra was defined by Riečan and Mundici [4].
Definition 8.
A sequence z n n = 1 of observables in a probability MV-algebra M , m is said to converge to zero m-almost everywhere (m-a.e.), if:
lim p lim k lim i m n = k k + i z n 1 p , 1 p = 1 .

3. Generalized Versions of the MV-Algebraic Strong Law of Large Numbers

3.1. The Kolmogorov Probability Space of Observables

In the further part of this section, we will use the Kolmogorov probability space of observables considered by Riečan and Mundici [4].
Let x i i = 1 be a sequence of independent observables in a probability MV-algebra M , m . Let R N be the space of all sequences of real numbers. Let C be the collection of cylinders of R N , i.e., the collection of all sets C = X i N C i R N , where C i B ( R ) and i : C i R is finite. The probability measure P : B ( R N ) [ 0 , 1 ] is uniquely described by:
P ( C ) = i m x i ( C i )
for every C C of the above form.
We call the triplet ( R N , B ( R N ) , P ) the Kolmogorov probability space of the observables x i i = 1 in M , m .
For each n N , we define the n th coordinate random variable ı n : R N R and n th coordinate random vector ı ¯ n : R N R n by the formulas:
ı n u 1 , u 2 , = u n , ı ¯ n u 1 , u 2 , = u 1 , u 2 , , u n .
We recall a shortened version of Proposition 2.14 from [4].
Proposition 1.
Let M , m be a probability MV-algebra and x i i = 1 be a sequence of independent observables in M , m , with h n : B R n M being the joint observable of x i i = 1 n . Let ( R N , B ( R N ) , P ) be the Kolmogorov probability space of the observables x i i = 1 in M , m . For each n N , let g n : R n R be an arbitrary Borel function. Let further the observable y n : B R M be defined by y n = h n g n 1 and the random variable η n : R N R be described by η n = g n ı ¯ n . Then:
P η n 1 = m y n
and the convergence of η i i = 1 to zero P-a.s.implies the convergence of y i i = 1 to zero m-a.e.

3.2. Generalized SLLN for Independent Observables

In this section, we formulate and prove MV-algebraic counterparts of the Marcinkiewicz–Zygmund and Brunk–Prokhorov SLLN (see Appendix A).
In the following part of the paper, in formulas containing integrals, we will assume that t R k for an appropriate value of k N .
Let X , X and X , X be measurable spaces and a function T : X X be X / X measurable. For a given measure μ on X , the image measure μ T 1 on X has the form:
μ T 1 A = μ T 1 A , A X .
We will use the following lemma (a generalization of Lemma 3.2 from [10]), which shows the form of the expected value of a Borel function of an observable.
Lemma 1.
Let M , m be a probability MV-algebra and d N . Then, for any R -valued Borel function φ : R d R and observables h : B R d M , y = φ h : B R M in M , m , the expected value E y exists if and only if:
R d | φ t | d m h t < .
Furthermore, if the above condition is satisfied, then:
E y = R d φ t d m h t .
Proof. 
Let X , X = R d , B R d , X , X = R , B R , and T = φ . By Theorem 1, μ = m h is a probability measure. Furthermore, by straightforward computations, we obtain:
μ T 1 = m φ h = m y .
Therefore, application of the following change of variable formula (see Theorem 16.12 in [29]):
X T x d μ x = X x d ( μ T 1 ) x
ends the proof. □
The MV-algebraic version of the Marcinkiewicz–Zygmund SLLN concerns the case of independent observables belonging to L m p for p 0 , 2 and a normalizing sequence that is a suitable power of n as follows.
Theorem 2.
Given a probability MV-algebra M , m , let x i i = 1 be an independent sequence of observables in M , m having the same distribution m x 1 . Let p 0 , 2 , x 1 L m p , c = 0 for 0 < p < 1 and c = E x 1 for 1 p < 2 . Then:
x 1 + x 2 + + x n n c n 1 / p
converges to zero m-a.e.
Proof. 
Let ( R N , B ( R N ) , P ) be the Kolmogorov probability space of the observables x i i = 1 in M , m . The sequence ı i i = 1 of the coordinate random variables is independent and identically distributed, i.e.,
P ı i 1 = m x i = m x 1 .
Thus, applying Lemma 1, we obtain:
E ı i = E x i = c for 1 p < 2 and E | ı i | p = E | x i | p < , i N .
Then, c = 0 for 0 < p < 1 and c = E ı 1 for 1 p < 2 . For each n N , we denote by h n the joint observable of x i i = 1 n , by g n the function:
g n t 1 , t 2 , , t n = t 1 + t 2 + + t n n c n 1 / p
and by y n the observable:
y n = h n g n 1 .
We also introduce the sequence of random variables η n n = 1 , assuming that η n = g n ( ı ¯ n ) . From Theorem A1, it follows that η n n = 1 converges to zero a.s. By Proposition 1:
P η n 1 = m y n
and y n converges to zero m-a.e. □
The following MV-algebraic version of the Brunk–Prokhorov SLLN concerns sequences of observables that are not necessarily identically distributed.
Theorem 3.
Let p 2 . Given a probability MV-algebra M , m , let x i i = 1 be an independent sequence of observables in M , m such that E x i = 0 , x i L m p for each i N . Let:
i = 1 E | x i | p i p / 2 + 1 < .
Then:
lim n x 1 + x 2 + + x n n = 0   m - a . e .
Proof. 
We denote by ( R N , B ( R N ) , P ) the Kolmogorov probability space of the observables x i i = 1 in M , m . For the independent sequence ı i i = 1 of the coordinate random variables, by Lemma 1,
E ı i = E x i = 0 and E | ı i | p = E | x i | p < , i N .
Therefore, by (6) and Theorem A2,
lim n ı 1 + ı 2 + + ı n n = 0 P - a . s .
Thus, applying Proposition 1 for g n n = 1 of the form:
g n t 1 , t 2 , , t n = t 1 + t 2 + + t n n ,
we obtain the convergence:
lim n x 1 + x 2 + + x n n = 0 m - a . e .
 □

3.3. Generalized SLLN for Non-Negative Observables

In this subsection, we consider the convergence of observables in a probability MV-algebra with product M , m , · , i.e., a probability MV-algebra M , m with an additional associative and commutative binary operation · : M × M M such that for each a , b , c M : ( i ) 1 · a = a ; ( i i ) a · b ¬ c = a · b ¬ a · c .
Remark 2.
Let x 1 , x 2 , , x n : B R M be observables in a probability MV-algebra with product M , m , · . By Proposition 2.4 from [4], each probability MV-algebra is weakly σ-distributive. Therefore, Theorem 3.6 from [4] implies that there exists an n-dimensional observable h n : B R n M such that for arbitrary C 1 , C 2 , , C n B R :
h n C 1 × C 2 × × C n = x 1 C 1 · x 2 C 2 · · x n C n ,
called the joint observable of x 1 , x 2 , , x n . Moreover, for arbitrary Borel measurable function g n : R n R , the formula:
g n x 1 , x 2 , , x n = h n g n 1 : B R M
defines a one-dimensional observable.
Let x i i = 1 be a sequence of observables in a probability MV-algebra with product M , m , · . Let for each n N h n : B R n M be the joint observable of x 1 , x 2 , , x n , defined in the above remark. Then, analogous to the case of probability MV-algebra, the application of the Kolmogorov consistency theorem for probability measures P n = m h n implies the existence of exactly one probability measure P : B ( R N ) [ 0 , 1 ] such that for each n N and A B ( R n ) , P ı ¯ n 1 A = P n A , where ı ¯ n is given by (3). We call the triplet ( R N , B ( R N ) , P ) the Kolmogorov probability space of the observables x i i = 1 in M , m , · . Both ı n : R N R and ı ¯ n : R N R n are random variables on ( R N , B ( R N ) , P ) .
The following proposition is a consequence of Theorem 3.17 and Proposition 3.16 from [4].
Proposition 2.
Let M , m , · be a probability MV-algebra with product and x i i = 1 be a sequence of observables in M , m , · , with h n : B R n M being the joint observable of x i i = 1 n . Let ( R N , B ( R N ) , P ) be the Kolmogorov probability space of the observables x i i = 1 in M , m , · . For each n N , let g n : R n R be an arbitrary Borel function. Let further the observable y n : B R M be defined by y n = h n g n 1 and the random variable η n : R N R be described by η n = g n ı ¯ n . Then, the convergence of η i i = 1 to zero P-a.s. implies the convergence of y i i = 1 to zero m-a.e.
We formulate and prove the main theorem of this subsection. For its classical counterpart and some notations, we refer the reader to Appendix A.
Theorem 4.
Let observables x i i = 1 in a probability MV-algebra with product M , m , · be non-negative, i.e.,
m x i ( [ 0 , ) = 1 , i N ,
and their absolute moments of some order p 1 be finite. Let a n n = 1 be a non-decreasing unbounded sequence of positive numbers. If E s n = O a n , where:
s n = x 1 + x 2 + + x n , n N ,
and:
E | x 1 + x 2 + + x n E i = 1 n x i | p = O a n p ψ a n ,
where ψ is a function belonging to Ψ c , then:
lim n x 1 + x 2 + + x n i = 1 n E x i a n = 0   m - a . e .
Proof. 
Let ( R N , B ( R N ) , P ) be the Kolmogorov probability space of the observables x i i = 1 in M , m , · . Let for arbitrary n N the functions φ 1 , n , φ 2 , n : R n R be given by:
φ 1 , n t 1 , t 2 , , t n = t 1 + t 2 + + t n φ 2 , n t 1 , t 2 , , t n = | t 1 + t 2 + + t n i = 1 n E x i | p ,
random variables η 1 , n , η 2 , n have the forms
η 1 , n = φ 1 , n ı ¯ n , η 2 , n = φ 2 , n ı ¯ n
and observables:
s n = φ 1 , n x 1 , x 2 , , x n : B R M , y 2 , n = φ 2 , n x 1 , x 2 , , x n : B R M
be defined as in Remark 2. The distributions of coordinate random variables ı i i = 1 are given by:
P ı i 1 = m x i , i N .
Moreover,
P ı ¯ n 1 = m h n , n N .
Applying Lemma 1, we obtain:
E ı i = E x i , E | ı i | p = E | x i | p < , i N ,
and:
E η 1 , n = R N φ 1 , n ı ¯ n d P = R n φ 1 , n t d ( P ı ¯ n 1 ) t = R n φ 1 , n t d m h n t     = E s n = O a n , E η 2 , n = R N φ 2 , n ı ¯ i d P = R n φ 2 , n t d ( P ı ¯ i 1 ) t     = R n φ 2 , n t d m h n t = E y 2 , n = O a n p ψ a n , n N .
Clearly, P ı i [ 0 , ) = m x i [ 0 , ) = 1 , i N . Finally, application of Theorem A3 for the sequence of random variables ı i i = 1 and Proposition 2 for the sequence of Borel functions:
g n : R n R , n N , g n t 1 , t 2 , , t n = t 1 + t 2 + + t n i = 1 n E x i a n
ends the proof. □
We also present two special cases of the above theorem, corresponding to Theorem 2 and 3, formulated by Korchevsky [30] within the Kolmogorov probability theory.
Theorem 5.
Let observables x i i = 1 in a probability MV-algebra with product M , m , · be non-negative and have finite variances. Let a n n = 1 be a non-decreasing unbounded sequence of positive numbers. If E s n = O a n and:
D 2 s n = O a n 2 ψ a n
for some function ψ Ψ c , then:
lim n x 1 + x 2 + + x n i = 1 n E x i a n = 0   m - a . e .
Theorem 6.
Let observables x i i = 1 in a probability MV-algebra with product M , m , · be non-negative and have finite absolute moments of some order p 1 . Let w n n = 1 be a sequence of positive numbers,
W n = i = 1 n w i , τ n = i = 1 n w i x i , n N ,
lim n W n = , E τ n = O W n and:
E | τ n E τ n | p = O W n p ψ W n
for some function ψ Ψ c . Then:
lim n τ n E τ n W n = 0   m - a . e .
Theorem 5 follows from Theorem 4 applied for p = 2 , whereas Theorem 6 is a consequence of Theorem 4 for arbitrary p 1 , the sequence of observables y i = w i x i , n N , and the sequence of real numbers a n = W n , n N .

4. Illustrative Examples

We analyze the asymptotic behavior of scaled sums of three sequences of observables. They are independent identically continuously distributed in the first sequence and independent identically discretely distributed in the second one, whereas the third example concerns non-negative dependent observables. The MV-algebraic version of the Kolmogorov SLLN, presented in [9], cannot be applied in the first two examples. Therefore, we use the MV-algebraic versions of the Marcinkiewicz–Zygmund and Brunk–Prokhorov theorems. The case of dependent observables is new, and it requires application of the MV-algebraic version of the Korchevsky theorem.

4.1. Sequence of Identically Distributed Observables

We consider observables taking values in the probability MV-algebra M , m consisting of the MV-algebra M = 0 , 1 equipped with the operations ¬ , , defined by the formulas:
¬ a = 1 a , a b = ( a + b ) 1 , a b = a + b 1 0 ,
where +, −, ∧, and ∨ have the usual meaning of addition, subtraction, minimum, and maximum, and the faithful state m of the form m t = t .
Let p > 0 , γ = 7 4 , C γ = 3 8 , and:
f t = C γ | t | γ I | t | 1 t .
Let for each j N an observable x j : B R M be described by the equality:
x j A = A f t d t .
We assume that the observables defined above are independent. For each n N , the joint observable h n : B R n M of x j j = 1 n has the form of the product measure given for each A B R n by:
h n A = A f t 1 f t 2 f t n d t 1 d t 2 d t n .
Then, applying Lemma 1, we obtain:
E | x 1 | p = 2 C γ 1 t p 7 4 d t = 2 C γ γ 1 p < f o r p < γ 1 ; f o r p γ 1 .
Thus, E x 1 2 = , and therefore, the MV-algebraic version of the Kolmogorov SLLN, presented in [9], does not concern the considered case. However, application of Theorem 2 gives the convergence:
x 1 + x 2 + + x n n r n 0 m - a . e .
for arbitrary r > 1 γ 1 = 4 3 .

4.2. Sequence of Not Identically Distributed Observables

Let M , m be the probability MV-algebra, defined in the previous subsection.
We fix p 2 . Let e 1 j = j 1 / 4 , e 2 j = j 1 / 4 , p 1 j = p 2 j = 1 2 for j N . Let a sequence of independent observables:
x j : B R M , j N
be defined by for each A B R by the equality:
x j A = e i j A , i 1 , 2 p i j .
For an arbitrary positive integer n, the joint observable h n : B R n M of the sequence x j j = 1 n is the product measure given for each A B R n by the equality:
h n A = e i 1 1 , e i 2 2 , , e i n n A , i 1 , i 2 , , i n 1 , 2 p i 1 1 p i 2 2 p i n n     = e i 1 1 , e i 2 2 , , e i n n A , i 1 , i 2 , , i n 1 , 2 1 2 n .
Then, E | x j | p = j p / 4 < for j N , and therefore,
j = 1 E | x j | p j p / 2 + 1 = j = 1 1 j p / 4 + 1 < .
Thus, by Theorem 3,
x 1 + x 2 + + x n n n 0 m - a . e .

4.3. Sequence of Dependent Observables

We consider a probability MV-algebra with the product, presented in [4]. Let Ω , S , P be a probability space and F 0 be the set of all S-measurable functions f : Ω 0 , 1 . F 0 , called a full tribe, equipped with the operations ¬ , , , · given by:
¬ f x = 1 f x , f g x = ( f x + g x ) 1 , f g x = f x + g x 1 0 , f · g x = f x · g x , x Ω ,
is an MV-algebra with product. 0 = 0 Ω and 1 = 1 Ω , where for arbitrary c 0 , 1 c Ω is the function identically equal to c on Ω . Let a state m 0 on F 0 be defined by the formula:
m 0 f = Ω f d P .
The ideal J = f F 0 : m 0 f = 0 in F 0 is closed under countable suprema. Therefore, the quotient MV-algebra F = F 0 / J (with the operations ¬ , , , · arising via θ ) is σ -complete, the quotient map θ : F 0 F is a σ -homomorphism, m : F 0 , 1 given by m θ f = m 0 f is a faithful state on F , and F , m , · is a probability MV-algebra with product (see [4]).
Let Ω , S , P = 0 , 1 , B 0 , 1 , λ [ 0 , 1 ] , where λ [ 0 , 1 ] is the Lebesgue measure on 0 , 1 . For the fixed constant γ = 1 2 and sequence α i i = 1 , α i = 1 2 i , we define a sequence z i i = 1 of independent observables in F , m , · , given for arbitrary A B R by the equality:
z i A = θ 1 Ω if A 0 , 1 = 0 , 1 ; θ γ Ω if A 1 = 1 ; θ 1 γ Ω if A 0 = 0 ; θ 0 Ω if A 0 , 1 =
and a sequence x i i = 1 of observables in F , m , · of the form:
x i = α i z 1 + 1 α i z i , i N .
Let for n N h n be the joint observable of z i i = 1 n ,
A n = i = 2 n α i = 1 2 1 2 n , B n = i = 2 n α i 2 = 1 12 1 3 1 4 n , a n = n .
Clearly,
m z i d t = γ δ 1 + 1 γ δ 0 d t .
Let p 1 . Then, for i N E | z i | p = E z i p = γ , D 2 z i = γ 1 γ , E | x 1 | 2 = γ . Moreover, by Lemma 1, for i 2 :
E | x i | 2 = E | α i z 1 + 1 α i z i | 2 = R i | α i t 1 + 1 α i t i | 2 d m h i t     = R 2 ( α i t 1 + 1 α i t i ) 2 d m z 1 t 1 d m z i t i     = α i 2 γ + 2 α i 1 α i γ 2 + 1 α i 2 γ < .
Let for a fixed n N β 1 = 1 + A n and β i = 1 α i , 2 i n . Then, s n = i = 1 n β i z i , and by Lemma 1:
E s n = R n ( i = 1 n β i t i ) d m h n t = i = 1 n R β i t i d m z i t i = i = 1 n β i E z i    = γ i = 1 n β i = γ 1 + A n + n 1 A n = γ n = 1 2 n = O a n
as well as:
E | s n E s n | 2 = E i = 1 n β i z i i = 1 n β i E z i 2 = R n i = 1 n β i t i i = 1 n β i E z i 2 d m h n t = R n i = 1 n β i t i E z i 2 d m h n t = R n i = 1 n β i 2 t i E z i 2 + 2 1 i < j n β i β j t i E z i t j E z j d m h n t = i = 1 n β i 2 R t i E z i 2 d m z i t i + 2 1 i < j n β i β j R 2 t i E z i t j E z j d m z i t i d m z j t j = i = 1 n β i 2 D 2 z i = γ 1 γ i = 1 n β i 2 = γ 1 γ 1 + 2 A n + A n 2 + n 1 2 A n + B n = 1 4 n + 2 3 1 4 n 1 2 n + 1 3 = O a n 2 ψ a n ,
where ψ x = x Ψ c . Thus, by Theorem 5 (or Theorem 4 for p = 2 ):
lim n x 1 + x 2 + + x n n γ n = 0   m - a . e .

5. Conclusions

This paper is devoted to the development of MV-algebraic probability theory. We formulate and prove three generalized versions of the strong law of large numbers. The first two versions of the strong law, i.e., the MV-algebraic Marcinkiewicz–Zygmund SLLN and Brunk–Prokhorov SLLN, describe the asymptotic behavior of the sums of independent observables, whereas the third one, i.e., the Korchevsky SLLN, concerns the case of dependent observables. Their proofs require an application of the Kolmogorov theory of probability and some measure-theoretic techniques. To illustrate our theoretical results, we also present and analyze some examples of sequences of observables in a probability MV-algebra. We believe that our results open new possibilities for further development of the MV-algebraic probability theory in the non-Kolmogorovian setting. In particular, they can be used for the future development of the theory of fuzzy, intuitionistic fuzzy, and interval-valued fuzzy random events in complex spaces. We would like to apply the proven theorems to the estimation of logical entropy, as well as other types of entropy in the case of intuitionistic fuzzy random events. This requires, among other things, the definition of entropy for observables in MV-algebras.

Author Contributions

This paper was prepared using the contributions of both authors. P.N. mainly contributed to developing the mathematical model. O.H. contributed to the interpretation of the obtained results. Both authors read and approved the final manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A. Classical Versions of the SLLN

Let X i i = 1 be a sequence of independent real-valued random variables on a probability space Ω , S , P , and let S n = X 1 + X 2 + + X n for each n N . Apart from the Kolmogorov SLLN for identically distributed sequence X i i = 1 such that E | X 1 | < , its Marcinkiewicz–Zygmund generalization is known (see [31]):
Theorem A1
(Marcinkiewicz–Zygmund SLLN). Let the random variables X i i = 1 be independent identically distributed. Let p 0 , 2 . If E | X 1 | p < , then:
lim n S n n c n 1 / p = 0 P - a . s .
In the above formula, c = 0 if 0 < p < 1 and c = E X 1 if 1 p < 2 .
In the next theorem, the same distribution of the random variables is not required.
Theorem A2
(Brunk–Prokhorov SLLN). Let the random variables X i i = 1 be independent. Let q 1 . If E X i = 0 , E | X i | 2 q < for each i N and:
i = 1 E | X i | 2 q i q + 1 < ,
then lim n S n n = 0 P-a.s.
The above theorem was proven by Brunk [32] for arbitrary positive integer q and by Prokhorov [33] for arbitrary q 1 .
Let Ψ c be the set of positive functions ψ ( x ) , non-decreasing in the interval x > x 0 for some x 0 , such that n = 1 1 n ψ ( n ) < .
The following Korchevsky generalization of the Petrov SLLN (see [30]) gives a sufficient condition for the convergence of scaled sums of random variables without the independence condition.
Theorem A3
(Korchevsky). Let the random variables X i i = 1 be non-negative with finite absolute moments of some order p 1 . Let a n n = 1 be a non-decreasing unbounded sequence of positive numbers. If ES n = O a n and there exists a function ψ Ψ c such that E | S n ES n | p = O a n p ψ a n , then:
lim n S n ES n n = 0 P - a . s .

References

  1. Chang, C.C. Algebraic Analysis of Many Valued Logics. Trans. Am. Math. Soc. 1958, 88, 467–490. [Google Scholar] [CrossRef]
  2. Cignoli, R.; D’Ottaviano, I.; Mundici, D. Algebraic Foundations of Many-Valued Reasoning; Kluwer: Dordrecht, The Netherlands, 2000. [Google Scholar]
  3. Dvurečenskij, A.; Pulmannová, S. New Trends in Quantum Structures; Kluwer Academic Publishers: Dordrecht, The Netherlands; Ister Science: Bratislava, Slovakia, 2000. [Google Scholar]
  4. Riečan, B.; Mundici, D. Probability on MV-algebras. In Handbook of Measure Theory; Pap, E., Ed.; Elsevier: Amsterdam, The Netherlands, 2002; pp. 869–909. [Google Scholar]
  5. Carathéodory, C. Mass und Integral und Ihre Algebraisierun; Birkäuser: Basel, Switzerland, 1956. [Google Scholar]
  6. Mundici, D. Logic of infinite quantum system. Int. J. Theor. Phys. 1993, 32, 1941–1955. [Google Scholar] [CrossRef]
  7. Mundici, D. Advanced Lukasiewicz Calculus and MV-Algebras; Springer: New York, NY, USA, 2011. [Google Scholar]
  8. Riečan, B. On the probability theory on MV-algebras. Soft Comput. 2000, 4, 49–57. [Google Scholar] [CrossRef]
  9. Riečan, B.; Neubrunn, T. Integral, Measure and Ordering; Kluwer: Bratislava, Slovakia, 1997. [Google Scholar]
  10. Nowak, P.; Hryniewicz, O. Generalized versions of MV-algebraic central limit theorems. Kybernetika 2015, 51, 765–783. [Google Scholar] [CrossRef]
  11. Lendelová, K. Conditional IF-probability. In Advances in Soft Computing: Soft Methods for Integrated Uncertainty Modelling; Lawry, J., Miranda, E., Bugarin, A., Li, S., Gil, M.A., Grzegorzewski, P., Hryniewicz, O., Eds.; Springer: Berlin/Heidelberg, Germany, 2006; pp. 275–283. [Google Scholar]
  12. Lendelová, K.; Petrovičová, J. Representation of IF-probability for MV-algebras. Soft Comput. 2006, 10, 564–566. [Google Scholar] [CrossRef]
  13. Michalíková, A.; Riečan, B. On invariant IF-state. Soft Comput. 2018, 22, 5043–5049. [Google Scholar] [CrossRef]
  14. Nowak, P.; Hryniewicz, O. On generalized versions of central limit theorems for IF-events. Inf. Sci. 2016, 355, 299–313. [Google Scholar] [CrossRef]
  15. Nowak, P.; Hryniewicz, O. On central limit theorems for IV-events. Soft Comput. 2018, 22, 2471–2483. [Google Scholar] [CrossRef]
  16. Renčová, M. A generalization of probability theory on MV-algebras to IF-events. Fuzzy Sets Syst. 2010, 161, 1726–1739. [Google Scholar] [CrossRef]
  17. Ciungu, L.C.; Riečan, B. Representation theorem for probabilities on IFS-events. Inf. Sci. 2010, 180, 793–798. [Google Scholar] [CrossRef]
  18. Riečan, B. Probability theory on IF events. In Trends and Progress in System Identification. Papers in Honor of Daniele Mundici on the Occasion of His 60th Birthday; Aguzzoli, S., Ciabattoni, A., Gerla, B., Manara, C., Marra, V., Eds.; Lecture Notes in Computer Science 4460; Springer: Berlin, Germany, 2007; pp. 290–308. [Google Scholar]
  19. Szmidt, E.; Kacprzyk, J. A Concept of a Probability of an Intuitionistic Fuzzy Event. In Proceedings of the FUZZ-IEEE’99—1999 IEEE International Fuzzy Systems Conference Proceedings, Seoul, Korea, 22–25 August 1999; pp. 1346–1349. [Google Scholar]
  20. Pulmannová, S. A note on observables on MV-algebras. Soft Comput. 2000, 4, 45–48. [Google Scholar] [CrossRef]
  21. Mesiar, R. Fuzzy sets, difference posets and MV-algebras. In Fuzzy Logic and Soft Computing; Bouchon–Meunier, B., Yager, R.R., Zadeh, L.A., Eds.; World Scientific: Singapore, 1995; pp. 345–352. [Google Scholar]
  22. Dvurečenskij, A. MV-Observables and MV-Algebras. J. Math. Anal. Appl. 2001, 259, 413–428. [Google Scholar] [CrossRef] [Green Version]
  23. Chovanec, F. States and observables on MV algebras. Tatra Mt. Math. Publ. 1993, 3, 55–65. [Google Scholar]
  24. Nowak, P.; Hryniewicz, O. Strong Laws of Large Numbers for IVM-events. IEEE Trans. Fuzzy Syst. 2019. [Google Scholar] [CrossRef]
  25. Pérez–Cruz, F. Estimation of Information Theoretic Measures for Continuous Random Variables. In Advances in Neural Information Processing Systems; Koller, D., Schuurmans, D., Bengio, Y., Bottou, L., Eds.; Curran Associates Inc.: Red Hook, NY, USA, 2009; pp. 1257–1264. [Google Scholar]
  26. Gao, Y.; Kontoyiannis, I.; Bienenstock, E. Estimating the entropy of binary time series: Methodology, some theory and a simulation study. Entropy 2008, 10, 71–99. [Google Scholar] [CrossRef]
  27. Antos, A.; Kontoyiannis, I. Convergence properties of functional estimates for discrete distributions. Random Struct. Algorithms 2001, 19, 163–193. [Google Scholar] [CrossRef]
  28. Markechová, D.; Riečan, B. Logical entropy and logical mutual information of experiments in the intuitionistic fuzzy case. Entropy 2017, 19, 429. [Google Scholar] [CrossRef]
  29. Billingsley, P. Probability and Measurey, 2nd ed; Wiley: New York, NY, USA, 1986. [Google Scholar]
  30. Korchevsky, V. A generalization of the Petrov strong law of large numbers. Statist. Probab. Lett. 2015, 104, 102–108. [Google Scholar] [CrossRef] [Green Version]
  31. Loève, M. Probability Theory I, 2nd ed.; Springer: New York, NY, USA, 1977. [Google Scholar]
  32. Brunk, H.D. The strong law of large numbers. Duke Math. J. 1948, 15, 181–195. [Google Scholar] [CrossRef]
  33. Prokhorov, Y.V. On the strong law of large numbers. Izvestiya Rossiiskoi Akademii Nauk Seriya Matematicheskaya 1950, 14, 523–536. [Google Scholar]

Share and Cite

MDPI and ACS Style

Nowak, P.; Hryniewicz, O. On MV-Algebraic Versions of the Strong Law of Large Numbers. Entropy 2019, 21, 710. https://doi.org/10.3390/e21070710

AMA Style

Nowak P, Hryniewicz O. On MV-Algebraic Versions of the Strong Law of Large Numbers. Entropy. 2019; 21(7):710. https://doi.org/10.3390/e21070710

Chicago/Turabian Style

Nowak, Piotr, and Olgierd Hryniewicz. 2019. "On MV-Algebraic Versions of the Strong Law of Large Numbers" Entropy 21, no. 7: 710. https://doi.org/10.3390/e21070710

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop