Abstract
We deal with Tsallis entropy in MV-algebraic dynamical systems. We prove that Tsallis entropy is a submeasure and that it is invariant under isomorphisms. We also provide two examples which show that Tsallis entropy allows one to distinguish some non-isomorphic MV-dynamical systems.
MSC:
37A35; 54C70
1. Introduction
Motivated by Constantino Tsallis’ significant discovery in 1988 regarding the notion of Tsallis entropy, we aim to introduce Tsallis entropy in the context of MV algebras and develop some of its properties. More specifically, the logical entropy and logical mutual information of partitions in a Riesz MV-algebra were studied in [1]. In this paper, we extend some of the results obtained in [1] from logical entropy to Tsallis entropy.
We recall that in information theory, Shannon’s entropy [2] is widely used, as it allows us to measure the amount of information gained from the realization of an experiment. Using Shannon’s entropy, Kolmogorov and Sinai [3,4] defined the entropy of dynamical systems, and they proved that this entropy is invariant under isomorphisms of dynamical systems.
However, as Ellerman noticed, Shannon’s entropy is not suitable for information theory because mutual information between three variables could be negative (however, this important remark went almost unnoticed in the literature). For this reason, Ellerman proposed logical entropy (see [5]), and Tsallis extended Ellerman’s work (see [6]).
In the classical framework, if is a probability distribution, then its Tsallis entropy of order , where , is defined as the following number:
If X is a continuous random variable with a probability density f, then the Tsallis entropy of order , where , is defined as the following number:
Tsallis entropies yield the Boltzmann–Gibbs–Shannon entropy
as a limit case for , as can easily be verified by writing and taking the limit above. Due to the flexibility of Tsallis entropy compared to Boltzmann–Gibbs–Shannon entropy, it has applications in many areas of information theory, physics, chemistry, and technology. Several properties and statistical aspects of Tsallis entropy can be found in [7,8,9,10,11,12,13].
This paper is organized as follows: Section 2 is devoted to the background of this research line. Definitions of entropy, particularly of logical entropy, and some facts are provided in Section 3. In subsequent sections, we focus on the Tsallis entropy of partitions and on the Tsallis entropy of MV-dynamical systems. More precisely, in Section 5 for A, B–two partitions–we introduced the conditional Tsallis entropy of A given B, and we discussed its properties. In Section 6, we prove that the Tsallis entropy is invariant under isomorphisms of MV-dynamical systems, and we offer two examples which show that Tsallis entropy allows one to distinguish some non-isomorphic MV-dynamical systems. Concluding remarks are presented in the final section.
2. Preliminaries and Notation
In this section, we give some basic notation on MV-algebras, states, and MV-algebraic dynamical systems.
Definition 1.
An MV-algebra is an algebra with a binary operation ⊕, a unary operation ¬, and a constant 0 satisfying the following equations:
(MV1)
(MV2)
(MV3)
(MV4)
(MV5)
(MV6)
Remark 1.
MV-algebras were introduced by Chang in [14].
On each MV-algebra E, we define Constant 1 and the operations ⊖ and ⊙ as follows:
(1) ;
(2) ;
(3) .
Let G be an ℓ-group. For each , let
and for each , let and . It is not hard to see that is an MV-algebra, which will be denoted by .
Definition 2.
A Riesz MV-algebra is a structure where is an MV-algebra, ⊙ is the Łukasiewicz product, and the operation satisfies the following identities for any and :
(RMV1) and whenever ;
(RMV2) and whenever ;
(RMV3) ;
(RMV4)
Remark 2.
Riesz MV-algebras are, up to isomorphism, unit intervals in Riesz spaces with a strong unit. They were introduced in [15].
In the sequel let E be an MV-algebra.
In every MV-algebra E, a partial sum can be defined by when , and are undefined otherwise.
Definition 3.
We define partition of unity in E as any finite sequence such that . Notice that the sequence A may contain repetitions.
Definition 4.
A refinement of a partition is a partition such that there is a partition of the set , such that . We write .
Definition 5.
An MV-algebra E is σ-complete if all countable subsets have both a supremum and an infimum.
Definition 6.
A state s on E is a mapping such that and for all with , .
Definition 7
([16]). By an MV-dynamical system, we mean a triple , where E is a σ-complete MV-algebra, τ is an automorphism of E, and is a state on E such that
The system is called a Riesz MV-dynamical system if E is a Riesz MV-algebra.
We say that two MV-dynamical systems and are isomorphic if there exists a bijective mapping satisfying the following conditions:
(i) f is an MV-algebra isomorphism;
(ii) for every ;
(iii) for every .
Two Riesz MV-dynamical systems are isomorphic if f is a Riesz MV-algebra isomorphism.
3. Entropies
In this section, we briefly recall some definitions of entropy. In particular, we recall the definition of logical entropy:
Definition 8.
Let s be as in Definition 7. Then, the Shannon entropy of a partition is the number
Proposition 1
(([17,18])).
Let be a tuple of partitions of unity of E, . It can be shown (using the Riesz decomposition property which holds in every MV algebra) that there is at least one common refinement of of the form
Any such partition is called a Riesz refinement of .
Remark 3.
By [17] on p. 146, in MV-algebras there exists a unique Riesz refinement of two partitions which satisfies
In the sequel, we always denote by this canonical Riesz refinement.
Definition 9.
Let s be as in Definition 7. Then, the logical entropy of a partition is the number
Let be a dynamical system in an MV-algebra E, and let A be a partition in E. Then we define the logical entropy of A relative to E by:
The logical entropy of is defined as
Remark 4.
We will see that the logical entropy of actually does not depend on τ.
Remark 5.
The logical entropy in the classical setting was introduced by Ellerman in [5].
4. Tsallis Entropy of Partitions
In this section, we introduce and study Tsallis entropy of partitions.
Definition 10.
Let be a partition in an MV-algebra E with a state s. Then, we define the Tsallis entropy of order α, where α is a real positive number different from 1, as
The index α describes the deviation of Tsallis entropy from the Shannon entropy.
Remark 6.
If we set , we obtain the logical entropy, and it is easy to check that is a nonnegative number for α less than 1.
Notation 1.
Let and be two partitions of unity in E. Let us put
if , where is the common refinement of A and B; otherwise, we set .
Moreover, let us write, for and and
Remark 7.
Notice that, since , the function is strictly concave.
Proposition 2.
If is a partition of unity and , then
- (i)
- ;
- (ii)
- whenever .
Proof.
Item (i) holds true since we have .
Item (ii) derives from item (i), as . □
Proposition 3.
If be any partition of unity in E and , then
The equality holds if and only if for
Proof.
The inequality follows from the non-negativity of function , so it is sufficient to prove the second assertion. We will use the Jensen inequality. Since the function is strictly concave, by applying the Jensen inequality, we have:
with the equality if and only if . Since , it follows that
The equality holds if and only if , i.e., if and only if for □
Proposition 4.
Let be partitions of unity such that and . Then,
Proof.
Suppose that . Then, there exists a partition of the set such that for . Therefore,
for . Then,
for . Summing both sides of the above inequality over i, we get
In this case, we have ; hence,
□
Proposition 5.
Let be partitions. Then, for , we have
Proof.
Applying the Jensen inequality, we have
for , and consequently,
The assumption that implies the inequality for . The function is non-negative; therefore, for , we get
and so
The last inequality combined with (*) yields the claim. □
In the next theorem, we prove that Tsallis entropy of partitions is a submeasure.
Theorem 1.
Let be partitions of unity. Then, for , one has
Proof.
We have
□
5. The Conditional Tsallis Entropy
In this section, we introduce the conditional Tsallis entropy of partitions and we give some properties.
Definition 11.
If are two partitions, then the conditional Tsallis entropy of A given B is defined by the formula
Next, lemma is a tool in the proof of Proposition 6.
Lemma 1.
Let be partitions of unity and be the Riesz common refinement of A and B. Then, we have
Proof.
We get
□
Proposition 6.
Let be partitions in E. Then
Proof.
Let , and . Then, by Lemma 1, we get
where is the Riesz common refinement of A and C, and is the Riesz common refinement of D and B. □
6. Tsallis Entropy of a MV-Dynamical System
In this section, we introduce and study -Tsallis entropy of MV-dynamical systems, with .
Definition 12.
Let be a dynamical system in an MV-algebra E, and let A be a partition of unity in E. Then, we define the strong Tsallis entropy of A by
Our next step is the definition of Tsallis entropy of an MV-dynamical system. For that, we need the following propositions:
Proposition 7.
Let be a dynamical system in an MV-algebra E, and A be a partition. Then, for any non-negative integer r, the following equality holds:
Proof.
Using the definition, we can write
□
Proposition 8.
Let be partitions such that . Then,
Proof.
Suppose .
Now if are partitions with and , then . So we have by induction
for every . Therefore, we get
Consequently, we get . □
Definition 13.
We define the Tsallis entropy of as
Notice that the Tsallis entropy of an MV-dynamical system does not depend on , as the following theorem shows:
Theorem 2.
Let be an MV-dynamical system. Then, the following two numbers are equal:
Proof.
Let A be a partition and .
Then, we have hence, by Proposition 4,
Therefore, . Moreover, we get , since is the sup of a set larger than the one which gives ; so . □
Corollary 1.
The Tsallis entropy of is independent of τ.
Example 1.
Let be the finite MV chain with three elements. Consider the dynamical system , where s is the unique state defined on E, for any t, and τ is the identity map. The only partitions of unity in E (up to zeros) are and . Then,
Indeed, and .
We calculate and
Hence,
Example 2.
Let be the standard MV-algebra. Consider the dynamical system , where s is the unique state defined on E, for any t, and τ is the identity map.
Consider, for every , the partition , where appears n times; we get by Proposition 3
Hence,
in particular,
The main result of this section is Theorem 3.
Theorem 3.
Let be isomorphic MV-dynamical systems. Then,
Proof.
Let a mapping represent an isomorphism of and . Let be a partition in ; then, is a partition in . We get
Hence, we derive—since the supremum on the left side of the inequality is taken over all partitions in and the supremum on the right side of the inequality is taken over all partitions in —the following:
We can argue analogously for obtaining the opposite inequality, so
hence, the thesis comes. □
We now give an example which shows that Tsallis entropy allows one to distinguish some non isomorphic dynamical systems. From now on, let .
Definition 14.
Let us define a partition A of E α-weakly mixing if the sequence is strictly increasing.
Remark 8.
The existence of an α-weakly mixing partition is an invariant of E under isomorphisms. So, weakly mixing partitions can be used to distinguish certain pairs of dynamical systems modulo isomorphism. Note that, unlike Tsallis entropies, which do not depend on τ, the existence of an α-weakly mixing partition in does depend on τ.
Let us consider the following example. It is very similar to the one contained in [1]; nevertheless, for the sake of completeness, we offer details.
Example 3.
Let , and consider the dynamical system (the circle) with
- E is the Riesz MV-algebra of Lebesgue measurable functions from S to , where ;
- , where l is the Lebesgue integral;
- for every , (we compose f with a rotation of the angle θ).
Proposition 9.
Let be as in Example 3. Then, it admits an α-weakly mixing partition if and only if is irrational.
Proof.
Let . Then, and, for every partition A, the sequence is constant for .
Let . Take the partition , where is the characteristic function of the upper half of S (including the extremes), and is the characteristic function of the lower half of S (excluding the extremes).
Let , and consider Obviously, refines . We claim that properly refines , that is, it has more blocks of nonzero measure.
In fact, consists of finitely many arcs whose extremes form the set
Indeed, for every the partition is given by the two half circles of extremes and . Consider the arc . One of its extremes is , and the equation , with and , is impossible, as is irrational. Hence, the arc divides some element of the partition into two smaller arcs of positive measure.
Therefore, properly refines , and by definition of , since by Remark 7 is strictly concave, we get . So the partition A is -weakly mixing in . □
The following corollary follows from the previous proposition:
Corollary 2.
Let be as in Example 3. Let and . Then, and are not isomorphic.
Another easy proof of the above corollary follows since rational rotations are periodic and irrational rotations are not.
Remark 9.
Let be as in Example 3. Since S admits partitions of measure for every n, Tsallis entropy of is the maximum possible, that is, .
Finally, we conclude the section by providing a further example (the torus) to distinguish MV-algebraic systems which generalizes Example 3.
Example 4.
Let , and consider the MV-dynamical system with
- E is the Riesz MV-algebra of Lebesgue measurable functions from to , where ;
- , where μ is the Lebesgue integral;
- for every , (we compose f with a rotation of x through the angle θ and a rotation of y through the angle ).
It turns out that the system has a weakly mixing partition if and only if at least one of θ and is an irrational multiple of π.
Remark 10.
Obviously, it is possible generalize Example 3 to n-ary Cartesian powers of S (n-tori).
Finally, notice that, both in Examples 3 and 4, (for and ), so it attains its maximum value, since for every n, there is a partition into n pieces of measure .
7. Conclusions
In this article, we explored Tsallis entropy in MV-algebras.
First, we introduced the concept of Tsallis entropy for partitions in MV-algebras (see Definition 10). In particular, by setting , we obtained the logical entropy of partitions in MV-algebras. Then, we presented some properties, e.g., we proved that Tsallis entropy is a submeasure. Finally, we proved that Tsallis entropy is invariant under isomorphisms of MV-dynamical systems and provided two examples showing that Tsallis entropy can distinguish between non-isomorphic MV-dynamical systems.
We hope this paper encourages further research in this field. For instance, it could be interesting to study general MV-dynamical systems where E is the Riesz MV-algebra of Haar-measurable functions from a Lie group G to , the state s is an integral associated with the Haar measure of G and an operator that preserves the Haar measure (e.g., a translation).
Author Contributions
Writing—original draft, G.G.B. and G.L. All authors have read and agreed to the published version of the manuscript.
Funding
The first named author is a member of the National Group for Algebraic and Geometric Structures and Their Applications (GNSAGA-INdAM).
Data Availability Statement
No new data were created or analyzed in this study.
Acknowledgments
We would like to thank the reviewers for all valuable comments and suggestions, which helped us to improve the quality of the manuscript.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Barbieri, G.; Bedrood, M.; Lenzi, G. Entropies and Dynamical Systems in Riesz MV-algebras. Int. J. Theor. Phys. 2023, 62, 113. [Google Scholar] [CrossRef]
- Shannon, C.E. A Mathematical Theory of Communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef]
- Sinai, Y.G. On the Notion of Entropy of a Dynamical System. Dokl. Russ. Acad. Sci. 1959, 124, 768–771. [Google Scholar]
- Kolmogorov, A.N. New Metric Invariant of Transitive Dynamical Systems and Automorphisms of Lebesgue Spaces. Dokl. Russ. Acad. Sci. 1958, 119, 861–864. [Google Scholar]
- Ellerman, D. An Introduction to Logical Entropy and Its Relation to Shannon Entropy. Int. J. Semantic Comput. 2013, 7, 121–145. [Google Scholar] [CrossRef]
- Tsallis, C. Possible generalization of Boltzmann-Gibbs statistics. J. Stat. Phys. 1988, 52, 479–487. [Google Scholar] [CrossRef]
- Alomani, G.; Kayid, M. Ghadah Alomani and Mohamed Kayid, Further Properties of Tsallis Entropy and Its Application. Entropy 2023, 25, 199. [Google Scholar] [CrossRef] [PubMed]
- Beck, C.; Yan, J. Information Shift Dynamics Described by Tsallis q = 3 Entropy on a Compact Phase Space. Entropy 2022, 24, 1671. [Google Scholar] [CrossRef] [PubMed]
- Chernyshov, K.R.; Jharko, E.P. An Information-Theoretic Approach to System Identification with Applying Tsallis Entropy. Ifac-Pap. Online 2018, 51, 24–29. [Google Scholar] [CrossRef]
- Khammar, A.H.; Jahanshahi, S.M.A. Quantile based Tsallis entropy in residual lifetime. Phys. Stat. Mech. Its Appl. 2018, 492, 994–1006. [Google Scholar] [CrossRef]
- Wilk, G.; Wlodarczyk, Z. Example of a possible interpretation of tsallis entropy. Phys. A Stat. Mech. Its Appl. 2008, 387, 4809–4813. [Google Scholar] [CrossRef]
- Zhang, Z. Uniform estimates on the tsallis entropies. Lett. Math. Phys. 2007, 80, 171–181. [Google Scholar] [CrossRef]
- Riečan, B.; Markechová, D. Tsallis Entropy of Product MV-Algebra Dynamical Systems. Entropy 2018, 20, 589. [Google Scholar] [CrossRef] [PubMed]
- Chang, C.C. A new proof of the completeness of the Łukasiewicz axioms. Trans. Am. Math. Soc. 1959, 93, 74–80. [Google Scholar]
- Bede, B.; Di Nola, A. Elementary calculus in Riesz MV-algebras. Int. J. Approx. Reason. 2004, 36, 129–149. [Google Scholar] [CrossRef][Green Version]
- Barbieri, G.; Lenzi, G. Entropy of MV-algebraic dynamical systems: An example. Math. Slovaca 2019, 69, 267–274. [Google Scholar] [CrossRef]
- Di Nola, A.; Dvurečenskij, A.; Hyčko, M.; Manara, C. Entropy on effect algebras with the Riesz decomposition property. I. Basic properties. Kybernetika 2005, 41, 143–160. [Google Scholar]
- Di Nola, A.; Dvurečenskij, A.; Hyčko, M.; Manara, C. Manara, Entropy on effect algebras with the Riesz decomposition property. II. MV-algebras. Kybernetika 2005, 41, 161–176. [Google Scholar]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).