Logical Divergence, Logical Entropy, and Logical Mutual Information in Product MV-Algebras

Abstract

In the paper we propose, using the logical entropy function, a new kind of entropy in product MV-algebras, namely the logical entropy and its conditional version. Fundamental characteristics of these quantities have been shown and subsequently, the results regarding the logical entropy have been used to define the logical mutual information of experiments in the studied case. In addition, we define the logical cross entropy and logical divergence for the examined situation and prove basic properties of the suggested quantities. To illustrate the results, we provide several numerical examples.

1. Introduction

In all areas of empirical research, it is very important to know how much information we gain by the realization of experiments. As it is known, the measure of information is entropy, the standard approach being based on Shannon entropy [1]. The standard mathematical model of an experiment in information theory [2] is a measurable partition of a probability space. Let us remind that a measurable partition of a probability space $(X,S,P)$ is a sequence $\mathcal{A}=\left\{A_1,\dots ,A_n\right\}$ of measurable subsets of $X$ such that ${\displaystyle {\cup }_{i=1}^n{A}_i}=X$ and $A_i\cap A_j=\varnothing$ whenever $i\ne j.$ The Shannon entropy of the measurable partition $\mathcal{A}=\left\{A_1,\dots ,A_n\right\}$ with probabilities $p_i=P(A_i),$ $i=1,\dots ,n,$ of the corresponding elements, is the number $h^S(\mathcal{A})={\displaystyle {\sum }_{i=1}^{n}S(p_i),}$ where $S:[0,1]\to \Re$ is the Shannon entropy function defined by the formula:

$$S(x)=\{\begin{array}{ll}\hfill -x\log x,\hfill & \hfill \mathrm{if}x>0;\\ \hfill 0,\hfill & \hfill \mathrm{if}x=0.\end{array}$$

(1)

In classical theory, partitions are defined within the Cantor set theory. However, it has turned out that, in many cases, the partitions defined in the context of fuzzy set theory [3] are more suitable for solving real problems. Hence, numerous suggestions have been put forward to generalize the classical partitions to fuzzy partitions [4,5,6,7,8,9,10]. Fuzzy partitions provide a mathematical model of random experiments the outcomes of which are unclear, inaccurately defined events. The Shannon entropy of fuzzy partitions has been studied by many authors; we refer the reader to, e.g., [11,12,13,14,15,16,17,18,19,20,21].

The notion of an MV-algebra, originally proposed by Chang in [22] in order to give an algebraic counterpart of the Łukasiewicz many-valued logic [23] (MV = many valued), generalizes some classes of fuzzy sets. MV-algebras have been investigated by numerous international research groups [24,25,26,27,28]. A Shannon entropy theory for MV-algebras was created in [29,30]. The fuzzy set theory is a rapidly evolving field of theoretical and applied mathematical research. At present the subjects of intensive study are also other algebraic structures based on the fuzzy set theory, such as D-posets [31,32,33], effect algebras [34], and A-posets [35,36]. Some results concerning Shannon’s entropy on these structures have been provided, e.g., in [37,38,39].

An important case of MV-algebras is the so-called product MV-algebra (see, e.g., [40,41,42,43,44,45]). This notion was proposed independently by two authors: Riečan [40] and Montagna [41]. A Shannon entropy theory for product MV-algebras was provided in [30,46,47]. We note that in the recently published paper [48], the results regarding the Shannon entropy of partitions in product MV-algebras were exploited to define the notions of Kullback-Leibler divergence and mutual information of partitions in product MV-algebras. The Kullback-Leibler divergence (often shortened to K-L divergence) was proposed in [49] as the distance between two probability distributions and it is currently one of the most basic quantities in information theory.

When addressing some special issues instead of Shannon entropy, it is preferable to use an approach based on the conception of logical entropy [50,51,52,53,54,55,56]. If $\mathcal{A}=\left\{A_1,\dots ,A_n\right\}$ is a measurable partition with probabilities $p_1,\dots ,p_n$ of the corresponding elements, then the logical entropy of $\mathcal{A}$ is defined by the formula $h^l(\mathcal{A})={\displaystyle {\sum }_{i=1}^{n}l(p_i),}$ where $l:[0,1]\to [0,1]$ is the logical entropy function defined by:

$$l(x)=x(1-x).$$

(2)

In [50], the author gives a history of the logical entropy formula $h^l(\mathcal{A})=1-{\displaystyle {\sum }_{i=1}^n{p}_i^2}.$ It is interesting that Alan Turing, who worked during the Second World War at the Bletchley Park facility in England, used the formula ${\displaystyle {\sum }_{i=1}^n{p}_i^2}$ in his famous cryptanalysis work. This formula was independently used by Polish crypto-analysts in their work [57] on the Enigma. The relationship between the Shannon entropy and the logical entropy is examined in [50]. In addition, the notions of logical cross entropy and logical divergence have been proposed in the cited paper. For some recent works related to the concept of logical entropy on algebraic structures based on fuzzy set theory, we refer the reader to (for example) [58,59,60,61,62,63,64,65].

The purpose of this article is to extend the study of logical entropy provided in [50] to the case of product MV-algebras. The remainder of the article is structured as follows. In Section 2 we present basic concepts, terminology and the known results that are used in the article. The results of the paper are given in the succeeding three sections. In Section 3, we define the logical entropy of partitions in product MV-algebras and its conditional version and examine their properties. In the following section, the results of Section 3 are exploited to define the concept of logical mutual information for the studied situation. Using the notion of logical conditional mutual information, we present chain rules for logical mutual information in product MV-algebras. In Section 5, we define the logical cross entropy and the logical divergence of states defined on product MV-algebras and we examine properties of these quantities. The results are explained with several examples to illustrate the theory developed in the article. The final section contains a brief overview. It is shown that by replacing the Shannon entropy function (Equation (1)) by the logical entropy function (Equation (2)) we obtain the results analogous to the results given in [48].

2. Preliminaries

The aim of the section is to provide basic concepts, terminology and the known results used in the paper.

Definition 1

[25]. An MV-algebra is an algebraic structure $\mathcal{M}=(M,\oplus ,\otimes ,\perp ,0,1),$ where $\oplus$ is a commutative and associative binary operation on $M,$ $\otimes$ is a binary operation on $M,$ $\perp$ is a unary operation on $M,$ $0,1\in M,$ such that $a\oplus 0=a;$ $a\oplus 1=1;$ ${(a^{\perp })}^{\perp }=a;$ $0^{\perp }=1;$ $a\oplus a^{\perp }=1;$ ${(a^{\perp }\oplus b)}^{\perp }\oplus b$ $={(a\oplus b^{\perp })}^{\perp }\oplus a;$ $a\otimes b=$ ${(a^{\perp }\oplus b^{\perp })}^{\perp }.$

Example 1.

Let $M$ be the unit real interval $[0, 1],$ $a^{\perp }=1-a,$ $a\oplus b=\min (a+b,1),$ $a\otimes b=$ $\max (a+b-1,0).$ Then the system $(M,\oplus ,\otimes ,\perp ,0,1)$ is an MV-algebra.

Example 2.

Let $(L,+,\le )$ be a commutative lattice ordered group (shortly l-group), i.e., $(L,+)$ is a commutative group, $(L,\le )$ is a partially ordered set being a lattice and $a\le b$ $⟹$ $a+c\le b+c.$ Let $u\in L$ be a strong unit of $L$ (i.e., to each $a\in L$ there exists a positive integer $n$ satisfying the condition $a\le nu$) such that $u>0,$ where 0 is a neutral element of $(L,+).$ Put $[0,u]=\{a\in L;0\le a\le u\},$ $a^{\perp }=u-a,$ $a\oplus b=(a+b)\wedge u,$ $a\otimes b=$ $(a+b-u)\vee 0,$ $1=u.$ Then the system ${\mathcal{M}}_0(L,u)=([0,u],\oplus ,\otimes ,\perp ,0,1)$ is an MV-algebra. Evidently, if $a,b\in L$ such that $a+b\le u,$ then $a\oplus b=a+b$ Moreover, it can be seen that the condition $a\otimes b=0$ is equivalent to the condition that $a+b\le u.$

By the following Mundici representation theorem, every MV-algebra $\mathcal{M}$ can be identified with the unit interval [0, u] of a unique (up to isomorphism) commutative lattice ordered group $L$ with a strong unit u. We say that $L$ is the l-group corresponding to $\mathcal{M}$.

Theorem 1

[66]. Let $\mathcal{M}$ be an MV-algebra. Then there exists a commutative lattice ordered group $L$ with a strong unit u such that $\mathcal{M}={\mathcal{M}}_0(L,u),$ and (L, u) is unique up to isomorphism.

Definition 2

[47]. Let $\mathcal{M}=(M,\oplus ,\otimes ,\perp ,0,1)$ be an MV-algebra. A partition in M is an n-tuple $\alpha =(a_1,\dots ,a_n)$ of elements of $M$ with the property $a_1+\dots +a_n=u,$ where $+$ is an addition in the l-group $L$ corresponding to $\mathcal{M}$ and $u$ is a strong unit of $L$.

In the paper we shall deal with product MV-algebras. The definition of product MV-algebra (cf. [40,41]), as well as the previous definition of partition in MV-algebra, is based on Mundici’s theorem, i.e., the MV-algebra operation $\oplus$ in the following definition, and in what follows, is substituted by the group operation $+$ in the commutative lattice ordered group $L$ that corresponds to the considered MV-algebra $\mathcal{M}.$ Analogously, the element u is a strong unit of $L$ and $\le$ is the partial-ordering relation in $L$.

Definition 3

[40]. A product MV-algebra is an algebraic structure $(M,\oplus ,\otimes ,·,\perp ,0,1)$ where $(M,\oplus ,\otimes ,\perp ,0,1)$ is an MV-algebra and $\cdot$ is a commutative and associative binary operation on $M$ with the following properties:

(i)

for every $a\in M,$ $u\cdot a=a;$

(ii)

if $a,b,c\in M$ such that $a+b\le u,$ then $c\cdot a+c\cdot b\le u,$ and $c\cdot (a+b)=c\cdot a+c\cdot b.$

For brevity, we will write $(M,\cdot )$ instead of $(M,\oplus ,\otimes ,·,\perp ,0,1)$ Further, we consider a state defined on $(M,\cdot )$ which plays the role of a probability measure on M. We note that a relevant probability theory for the product MV-algebras was developed in [44], see also [27,45].

Definition 4

[44]. A state on a product MV-algebra $(M,\cdot )$ is a map $s:M\to [0,1]$ with the properties:

(i)

$s(u)=1;$

(ii)

if $a,b\in M$ such that $a+b\le u,$ then $s(a+b)=s\left(a\right)+s\left(b\right)$.

Notice that the disjointness of the elements $a,b\in M$ is expressed in the previous definition by the condition $a+b\le u$ (or equivalently by $a\le u-b$). According to the Mundici theorem this condition can be formulated in the equivalent way as $a+b\in M$ or also as $a\otimes b=0.$ As is customary, we will write ${\sum }_{i=1}^n{a}_i$ instead of $a_1+\dots +a_n.$ Let $s:M\to [0,1]$ be a state. Applying induction we get that for any elements $a_1,\dots ,a_n\in M$ such that ${\displaystyle {\sum }_{i=1}^n{a}_i}\le u,$ it holds $s\left({\displaystyle {\sum }_{i=1}^n{a}_i}\right)={\displaystyle {\sum }_{i=1}^{n}s(a_i}).$

In the system of all partitions of $(M,\cdot ),$ we define the refinement partial order $\succ$ in a standard way (cf. [23]). If $\alpha =(a_1,\dots ,a_n),$ and $\beta =(b_1,\dots ,b_m)$ are two partitions of $(M,\cdot ),$ then we write $\beta \succ \alpha$ (and we say that $\beta$ is a refinement of $\alpha$), if there exists a partition $\left\{I(1),I(2),\dots ,I(n)\right\}$ of the set $\left\{1,2,\dots ,m\right\}$ such that $a_i={\displaystyle {\sum }_{j\in I\left(i\right)}{b}_j},$ for $i=1,\dots ,n.$ Further, we define $\alpha \vee \beta =$ $(a_i\cdot b_j;i=1,\dots ,n,j=1,2,\dots ,m).$ Since ${\displaystyle {\sum }_{i=1}^n{\displaystyle {\sum }_{j=1}^m{a}_i\cdot b_j}}$ $=\left({\displaystyle {\sum }_{i=1}^n{a}_i}\right)\cdot \left({\displaystyle {\sum }_{j=1}^m{b}_j}\right)$ $=u\cdot u=u,$ the system $\alpha \vee \beta$ is a partition of $(M,\cdot ).$ The partition $\alpha \vee \beta$ represents a combined experiment consisting of a realization of the considered experiments $\alpha$ and $\beta .$ If ${\alpha }_1,{\alpha }_2,\dots ,{\alpha }_n$ are partitions in a product MV-algebra $(M,\cdot ),$ then we put ${\vee }_{i=1}^n{\alpha }_i={\alpha }_1\vee {\alpha }_2\vee \dots \vee {\alpha }_n.$

3. Logical Entropy of Partitions in Product MV-Algebras

In this section we define the logical entropy and the logical conditional entropy of partitions in a product MV-algebra and derive their properties.

Definition 5.

Let $\alpha =(a_1,\dots ,a_n)$ be a partition in a product MV-algebra $(M,\cdot ),$ and $s:M\to [0,1]$ be a state. Then we define the logical entropy of $\alpha$ with respect to state s by the formula:

$$h_s^l(\alpha )={\displaystyle {\sum }_{i=1}^{n}s(a_i)}(1-s(a_i)).$$

(3)

Remark 1.

Evidently, the logical entropy $h_s^l(\alpha )$ is always nonnegative, and it has the maximum value $1-\frac{1}{n}$ for the state $s$ uniform over $\alpha =(a_1,\dots ,a_n).$ Since ${\displaystyle {\sum }_{i=1}^{n}s(a_i)}=s\left({\displaystyle {\sum }_{i=1}^n{a}_i}\right)=s(u)=1,$ Equation (3) can also be written in the following form:

$$h_s^l(\alpha )=1-{\displaystyle {\sum }_{i=1}^n{(s(a_i))}^2.}$$

(4)

Example 3.

Let $(M,\cdot )$ be a product MV-algebra and $s:M\to [0,1]$ be a state. If we put $\epsilon =(u),$ then $\epsilon$ is a partition of $(M,\cdot )$ with the property $\alpha \succ \epsilon ,$ for every partition $\alpha$ of $(M,\cdot ).$ Its logical entropy is $h_s^l(\epsilon )=0.$ Let $a\in M$ with $s(a)=p,$ where $p\in \left(0,1\right).$ It is obvious that the pair $\alpha =(a,u-a)$ is a partition of $(M,\cdot ).$ Since $s(u-a)=1-p,$ the logical entropy $h_s^l(\alpha )=2p(1-p).$ If we put $p=\frac{1}{2},$ then we have $h_s^l(\alpha )=\frac{1}{2}.$

In the proofs we shall use the following propositions.

Proposition 1.

Let $\alpha =(a_1,\dots ,a_n)$ be a partition of $(M,\cdot ).$ Then, for every $b\in M,$ we have:

$$s(b)={\displaystyle \sum _{i=1}^{n}s(a_i\cdot b)}.$$

Proof. 

According to Definitions 2, 3, and 4 we obtain:

$$s(b)=s(u\cdot b)=s(({\displaystyle \sum _{i=1}^n{a}_i})\cdot b)=s({\displaystyle \sum _{i=1}^n{a}_i\cdot b})={\displaystyle \sum _{i=1}^{n}s(a_i\cdot b)}.$$

 ☐

Proposition 2.

For arbitrary partitions $\alpha ,\beta$ of $(M,\cdot ),$ it holds $\alpha \vee \beta \succ \alpha .$

Proof. 

Let us suppose that $\alpha =(a_1,\dots ,a_n),$ $\beta =(b_1,\dots ,b_m).$ Put $I\left(i\right)=\left\{\left(i,1\right),\dots ,\left(i,m\right)\right\},$ for $i=1,\dots ,n.$ Since we have:

$$a_i=a_i\cdot u=a_i\cdot \left({\displaystyle {\sum }_{j=1}^m{b}_j}\right)={\displaystyle {\sum }_{j=1}^m{a}_i\cdot b_j=}{\displaystyle {\sum }_{(l,j)\in I(i)}{a}_l\cdot b_j},$$

for $i=1,\dots ,n,$ we conclude that $\alpha \vee \beta \succ \alpha .$ ☐

Proposition 3.

Let $\alpha ,\beta$ be partitions of $(M,\cdot )$ such that $\beta \succ \alpha .$ Then for an arbitrary partition $\gamma ,$ it holds $\beta \vee \gamma \succ \alpha \vee \gamma .$

Proof. 

Let $\alpha =(a_1,\dots ,a_n),$ $\beta =(b_1,\dots ,b_m),$ $\gamma =(c_1,\dots ,c_r),$ $\beta \succ \alpha .$ Then there is a partition $\left\{I(1),I(2),\dots ,I(n)\right\}$ of the set $\left\{1,2,\dots ,m\right\}$ such that $a_i={\displaystyle {\sum }_{j\in I\left(i\right)}{b}_j},$ for $i=1,\dots ,n.$ A partition $\alpha \vee \gamma$ $=\left(a_i\cdot c_k;i=1,\dots ,n,k=1,\dots ,r\right)$ is indexed by $\left\{(i,k);i=1,\dots ,n,k=1,\dots ,r\right\},$ therefore we put $I(i,k)=$ $\left\{(j,k);j\in I(i)\right\},$ for $i=1,\dots ,n,$ $k=1,\dots ,r.$ We obtain:

$$a_i\cdot c_k=\left({\displaystyle {\sum }_{j\in I(i)}{b}_j}\right)\cdot c_k={\displaystyle {\sum }_{j\in I(i)}{b}_j}\cdot c_k={\displaystyle {\sum }_{(j,l)\in I(i,k)}{b}_j}\cdot c_l,$$

for $i=1,\dots ,n,$ $k=1,\dots ,r.$ This implies that $\beta \vee \gamma \succ \alpha \vee \gamma .$ ☐

Definition 6.

If $\alpha =(a_1,\dots ,a_n)$ and $\beta =(b_1,\dots ,b_m)$ are partitions of $(M,\cdot ),$ then the logical conditional entropy of $\alpha$ given $\beta$ is defined by:

$$h_s^l(\alpha /\beta )={\displaystyle \sum _{i=1}^n{\displaystyle \sum _{j=1}^{m}s(a_i\cdot b_j)}}\cdot (s(b_j)-s(a_i\cdot b_j)).$$

(5)

Remark 2.

Since by Proposition 1, for $j=1,\dots ,m,$ it holds ${\displaystyle \sum _{i=1}^{n}s(a_i\cdot b_j)=}s(b_j),$ Equation (5) can be written in the following equivalent form:

$$h_s^l(\alpha /\beta )={\displaystyle \sum _{j=1}^m{(s(b_j))}^2}-{\displaystyle \sum _{i=1}^n{\displaystyle \sum _{j=1}^m{(s(a_i\cdot b_j))}^2}}.$$

(6)

Remark 3.

Since $s(a_i\cdot b_j)\le s(b_j),$ for $i=1,\dots ,n,j=1,\dots ,m$, the logical conditional entropy $h_s^l(\alpha /\beta )$ is always nonnegative. Let us consider the partition $\epsilon =(u).$ It can be easily verified that $h_s^l(\alpha /\epsilon )=h_s^l(\alpha ).$

Theorem 2.

For arbitrary partitions $\alpha ,\beta$ of $(M,\cdot ),$ it holds:

$$h_s^l(\alpha \vee \beta )=h_s^l(\alpha )+h_s^l(\beta /\alpha ).$$

(7)

Proof. 

Let us suppose that $\alpha =(a_1,\dots ,a_n),$ $\beta =(b_1,\dots ,b_m).$ Then by Equations (4) and (6) we obtain:

$$\begin{array}{c}{h}_s^l(\alpha )+h_s^l(\beta /\alpha )=1-{\displaystyle {\sum }_{i=1}^n{(s(a_i))}^2+{\displaystyle {\sum }_{i=1}^n{(s(a_i))}^2}-{\displaystyle {\sum }_{i=1}^n{\displaystyle {\sum }_{j=1}^m{(s(a_i\cdot b_j))}^2}}}\\ =1-{\displaystyle {\sum }_{i=1}^n{\displaystyle {\sum }_{j=1}^m{(s(a_i\cdot b_j))}^2}}=h_s^l(\alpha \vee \beta ).\end{array}$$

 ☐

Remark 4.

Let ${\alpha }_1,{\alpha }_2,\dots ,{\alpha }_n$ be partitions of $(M,\cdot ).$ Using now Equation (7), considering the partition ${\vee }_{i=1}^n{\alpha }_i={\alpha }_1\vee {\alpha }_2\vee \dots \vee {\alpha }_n$ and applying induction, we get:

$$h_s^l({\alpha }_1\vee \dots \vee {\alpha }_n)=h_s^l({\alpha }_1)+{\displaystyle {\sum }_{i=2}^n{h}_s^l({\alpha }_i/{\alpha }_1\vee \dots \vee {\alpha }_{i-1})}.$$

(8)

Theorem 3.

For arbitrary partitions $\alpha ,\beta$ of $(M,\cdot ),$ it holds:

(i)

$h_s^l(\alpha /\beta )\le h_s^l(\alpha );$

(ii)

$h_s^l(\alpha \vee \beta )\le h_s^l(\alpha )+h_s^l(\beta ).$

Proof. 

Let us suppose that $\alpha =(a_1,\dots ,a_n),$ $\beta =(b_1,\dots ,b_m).$

(i)

Since by Proposition 1, for $i=1,\dots ,n,$ it holds ${\displaystyle {\sum }_{j=1}^{m}s(a_i\cdot b_j)}=s(a_i),$ we obtain:

$${\displaystyle {\sum }_{j=1}^{m}s(a_i\cdot b_j)\cdot (s(b_j)-s(a_i\cdot b_j))}\le \left({\displaystyle {\sum }_{j=1}^{m}s(a_i\cdot b_j)}\right)\left({\displaystyle {\sum }_{j=1}^m(s(b_j)-s(a_i\cdot b_j))}\right)=s(a_i)\left({\displaystyle {\sum }_{j=1}^{m}s(b_j)-{\displaystyle {\sum }_{j=1}^{m}s(a_i\cdot b_j)}}\right)=s(a_i)(1-s(a_i)).$$

Therefore:

$$h_s^l(\alpha /\beta )={\displaystyle \sum _{i=1}^n{\displaystyle \sum _{j=1}^{m}s(a_i\cdot b_j)}}\cdot (s(b_j)-s(a_i\cdot b_j))\le {\displaystyle \sum _{i=1}^{n}s(a_i)(1-s(a_i))}=h_s^l(\alpha ).$$

(ii)

Combining Equation (7) and the previous property we obtain the claim (ii). ☐

In the following example, we illustrate the results of Theorem 3.

Example 4.

Let us consider the measurable space $([0,1],\mathcal{B}),$ where $\mathcal{B}$ is the $\sigma -$ algebra of all Borel subsets of the unit interval $[0,1].$ Put $M=\left\{I_A;A\in \mathcal{B}\right\},$ where $I_A$ is the indicator of the set $A,$ and define, for every $I_A,I_B\in M,$ the operation $\cdot$ by the equality $I_A\cdot I_B=I_{A\cap B}.$ The system $(M,\cdot )$ is a product MV-algebra with the unit element $u=I_X.$ Let us define a state $s:M\to [0,1]$ by the equality $s(I_A)=$ ${\displaystyle {\int }_0^1{I}_A(x)dx},$ for any element $I_A$ of $M.$ The pairs $\alpha =\left(I_{[0,\frac{1}{2}]},I_{[\frac{1}{2},1]}\right)$ and $\beta =\left(I_{[0,\frac{1}{3}]},I_{[\frac{1}{3},1]}\right)$ are partitions of $(M,\cdot )$ with the s-state values $\frac{1}{2},\frac{1}{2}$ and $\frac{1}{3},\frac{2}{3}$ of the corresponding elements, respectively. By Equation (4) we can easily calculate their logical entropy: $h_s^l(\alpha )=\frac{1}{2},$ $h_s^l(\beta )=\frac{4}{9}.$ The partition $\alpha \vee \beta =$ $\left(I_{[0,\frac{1}{3}]},I_{[\frac{1}{3},\frac{1}{2}]},I_{[\frac{1}{2},1]},0\right)$ has the s-state values $\frac{1}{3},\frac{1}{6},\frac{1}{2},0$ of the corresponding elements, and the logical entropy:

$$h_s^l(\alpha \vee \beta )=1-\left[{(\frac{1}{3})}^2+{(\frac{1}{6})}^2+{(\frac{1}{2})}^2\right]=\frac{11}{18}.$$

Since $\frac{11}{18}\le \frac{1}{2}+\frac{4}{9}$, the inequality $h_s^l(\alpha \vee \beta )\le h_s^l(\alpha )+h_s^l(\beta )$ holds. The logical conditional entropy of $\alpha$ given $\beta$ is the number:

$$h_s^l(\alpha /\beta )={\displaystyle \sum _{j=1}^2{(s(b_j))}^2}-{\displaystyle \sum _{i=1}^2{\displaystyle \sum _{j=1}^2{(s(a_i\cdot b_j))}^2={(\frac{1}{3})}^2+{(\frac{2}{3})}^2-\left[{(\frac{1}{3})}^2+{(\frac{1}{6})}^2+{(\frac{1}{2})}^2\right]=\frac{5}{9}-\frac{7}{18}}}=\frac{1}{6};$$

analogously we get the logical conditional entropy $h_s^l(\beta /\alpha )=\frac{1}{2}-\frac{7}{18}=\frac{1}{9}.$ It can be verified that:

$$h_s^l(\alpha \vee \beta )=h_s^l(\beta )+h_s^l(\alpha /\beta )=h_s^l(\alpha )+h_s^l(\beta /\alpha ).$$

Theorem 4.

For arbitrary partitions $\alpha ,\beta ,\gamma$ of $(M,\cdot ),$ it holds:

$$h_s^l(\alpha \vee \beta /\gamma )=h_s^l(\alpha /\gamma )+h_s^l(\beta /\alpha \vee \gamma ).$$

(9)

Proof. 

Let us suppose that $\alpha =(a_1,\dots ,a_p),$ $\beta =(b_1,\dots ,b_q),$ $\gamma =(c_1,\dots ,c_r).$ Using Equation (6) we can write:

$$\begin{array}{ll}\hfill h_s^l(\alpha /\gamma )+h_s^l(\beta /\alpha \vee \gamma )& ={\displaystyle \sum _{k=1}^r{(s(c_k))}^2}-{\displaystyle \sum _{i=1}^p{\displaystyle \sum _{k=1}^r{(s(a_i\cdot c_k))}^2}}+{\displaystyle \sum _{i=1}^p{\displaystyle \sum _{k=1}^r{(s(a_i\cdot c_k))}^2}}-{\displaystyle \sum _{j=1}^q{\displaystyle \sum _{i=1}^p{\displaystyle \sum _{k=1}^r{(s(b_j\cdot a_i\cdot c_k))}^2}}}\hfill \\ \hfill & ={\displaystyle \sum _{k=1}^r{(s(c_k))}^2}-{\displaystyle \sum _{i=1}^p{\displaystyle \sum _{j=1}^q{\displaystyle \sum _{k=1}^r(s(a_i\cdot b_j\cdot c_k)}}}{)}^2=h_s^l(\alpha \vee \beta /\gamma ).\hfill \end{array}$$

 ☐

Remark 5.

Let ${\alpha }_1,{\alpha }_2,\dots ,{\alpha }_n,\gamma$ be partitions of $(M,\cdot ).$ Using the principle of mathematical induction, we get the following generalization of Equation (9):

$$h_s^l({\alpha }_1\vee \dots \vee {\alpha }_n/\gamma )=h_s^l({\alpha }_1/\gamma )+{\displaystyle {\sum }_{i=2}^n{h}_s^l({\alpha }_i/{\alpha }_1\vee \dots \vee {\alpha }_{i-1}\vee \gamma )}.$$

(10)

If we put $\gamma =\epsilon ,$ as a special case of Equation (10) we get Equation (8).

Theorem 5.

For arbitrary partitions $\alpha ,\beta ,\gamma$ of $(M,\cdot ),$ it holds:

(i)

$\beta \succ \alpha$ implies $h_s^l(\beta )\ge h_s^l(\alpha );$

(ii)

$h_s^l(\alpha \vee \beta )\ge \max [h_s^l(\alpha );h_s^l(\beta )];$

(iii)

$\beta \succ \alpha$ implies $h_s^l(\beta /\gamma )\ge h_s^l(\alpha /\gamma ).$

Proof. 

(i)

Let $\alpha =(a_1,\dots ,a_k),$ $\beta =(b_1,\dots ,b_l).$ By the assumption that $\beta \succ \alpha$ there is a partition $\left\{I(1),I(2),\dots ,I(k)\right\}$ of the set $\left\{1,2,\dots ,l\right\}$ with the property $a_i={\displaystyle {\sum }_{j\in I\left(i\right)}{b}_j},$ for $i=1,\dots ,k.$ Therefore:

$$\begin{array}{c}{h}_s^l(\alpha )=1-{\displaystyle {\sum }_{i=1}^k{\left(s(a_i)\right)}^2}=1-{\displaystyle {\sum }_{i=1}^k{\left(s({\displaystyle {\sum }_{j\in I\left(i\right)}{b}_j})\right)}^2}=1-{\displaystyle {\sum }_{i=1}^k{\left({\displaystyle {\sum }_{j\in I(i)}s(b_j)}\right)}^2}\\ \le 1-{\displaystyle {\sum }_{i=1}^k{\displaystyle {\sum }_{j\in I(i)}{(s(b_j))}^2}}=1-{\displaystyle {\sum }_{j=1}^l{(s(b_j))}^2}=h_s^l(\beta ).\end{array}$$

We used the inequality ${\left({\displaystyle {\sum }_{j\in I(i)}s(b_j)}\right)}^2\ge {\displaystyle {\sum }_{j\in I(i)}{(s(b_j))}^2}$ that follows from the inequality ${\left(x_1+\dots +x_n\right)}^2\ge x_1^2+\dots +x_n^2$ applicable for all nonnegative real numbers $x_1,\dots ,x_n.$

(ii)

According to Proposition 2 it holds $\alpha \vee \beta \succ \alpha ,$ and $\alpha \vee \beta \succ \beta ,$ therefore, the property (ii) is a direct consequence of the property (i).

(iii)

Let $\beta \succ \alpha .$ Then by Proposition 3 we have $\beta \vee \gamma \succ \alpha \vee \gamma .$ Therefore, using Equation (7) and the property (i) we get:

$$h_s^l(\beta /\gamma )=h_s^l(\beta \vee \gamma )-h_s^l(\gamma )\ge h_s^l(\alpha \vee \gamma )-h_s^l(\gamma )=h_s^l(\alpha /\gamma ).$$

 ☐

In the following theorem, we prove the concavity of logical entropy $h_s^l(\alpha )$ as a function of s. By the symbol $S(M)$ we will denote the family of all states defined on M. It is easy to verify that if $s_1,s_2\in S(M),$ then, for every real number $\lambda \in [0,1],$ it holds that $\lambda s_1+(1-\lambda )s_2\in S(M).$

Theorem 6.

Let $\alpha$ be a given partition of $(M,\cdot ).$ Then, for every $s_1,s_2\in S(M)$, and for every real number $\lambda \in [0,1],$ it holds:

$$\lambda h_{s_1}^l(\alpha )+\left(1-\lambda \right)h_{s_2}^l(\alpha )\le h_{\lambda s_1+(1-\lambda )s_2}^l(\alpha ).$$

Proof. 

Let $\alpha =(a_1,\dots ,a_n).$ The function $\varphi :\Re \to \Re$ defined by $\varphi (x)=x^2,$ for every $x\in \Re$, is convex, therefore, for every real number $\lambda \in [0,1]$ and $i=1,2,\dots ,n,$ we have:

$${\left(\lambda s_1(a_i)+(1-\lambda )s_2(a_i)\right)}^2\le \lambda {\left(s_1(a_i)\right)}^2+(1-\lambda ){\left(s_2(a_i)\right)}^2.$$

Hence, we obtain:

$${\displaystyle {\sum }_{i=1}^n{\left(\lambda s_1(a_i)+(1-\lambda )s_2(a_i)\right)}^2}\le \lambda {\displaystyle {\sum }_{i=1}^n{\left(s_1(a_i)\right)}^2}+(1-\lambda ){\displaystyle {\sum }_{i=1}^n{\left(s_2(a_i)\right)}^2},$$

and, consequently:

$$1-{\displaystyle {\sum }_{i=1}^n{\left(\lambda s_1(a_i)+(1-\lambda )s_2(a_i)\right)}^2}\ge 1-\lambda {\displaystyle {\sum }_{i=1}^n{\left(s_1(a_i)\right)}^2}-(1-\lambda ){\displaystyle {\sum }_{i=1}^n{\left(s_2(a_i)\right)}^2}.$$

Therefore, we can write:

$$\begin{array}{c}\hfill \lambda h_{s_1}^l(\alpha )+\left(1-\lambda \right)h_{s_2}^l(\alpha )=\lambda \left[1-{\displaystyle {\sum }_{i=1}^n{\left(s_1(a_i)\right)}^2}\right]+(1-\lambda )\left[1-{\displaystyle {\sum }_{i=1}^n{\left(s_2(a_i)\right)}^2}\right]\hfill \\ \hfill =1-\lambda {\displaystyle {\sum }_{i=1}^n{\left(s_1(a_i)\right)}^2}-(1-\lambda ){\displaystyle {\sum }_{i=1}^n{\left(s_2(a_i)\right)}^2}\hfill \\ \hfill \le 1-{\displaystyle {\sum }_{i=1}^n{\left(\lambda s_1(a_i)+(1-\lambda )s_2(a_i)\right)}^2}\hfill \\ \hfill =1-{\displaystyle {\sum }_{i=1}^n{\left(\lambda s_1+(1-\lambda )s_2)(a_i)\right)}^2}=h_{\lambda s_1+(1-\lambda )s_2}^l(\alpha ).\hfill \end{array}$$

The result proves that the logical entropy $s\mapsto h_s^l\left(\alpha \right)$ is concave on the class $S(M).$ ☐

4. Logical Mutual Information in Product MV-Algebras

In this section, the previous results are exploited to introduce the concept of logical mutual information of partitions in product MV-algebras and its conditional version and to derive their properties. In particular, using the concept of logical conditional mutual information we formulate chain rules for the examined situation.

Definition 7.

Let $(M,\cdot )$ be a product MV-algebra. The logical mutual information of partitions $\alpha$ and $\beta$ in $(M,\cdot )$ is defined by:

$$I_s^l(\alpha ,\beta )=h_s^l(\alpha )-h_s^l(\alpha /\beta ).$$

(11)

Remark 6.

The inequality $h_s^l(\alpha /\beta )\le h_s^l(\alpha )$ implies that the logical mutual information $I_s^l(\alpha ,\beta )$ is always nonnegative. Since, by Equation (7), it holds $h_s^l(\alpha /\beta )=h_s^l(\alpha \vee \beta )-h_s^l(\beta ),$ we also have the following identity:

$$I_s^l(\alpha ,\beta )=h_s^l(\alpha )+h_s^l(\beta )-h_s^l(\alpha \vee \beta ).$$

(12)

Thereafter we can see that $I_s^l(\alpha ,\beta )=I_s^l(\beta ,\alpha ),$ and, due to the inequality $h_s^l(\alpha )\le h_s^l(\alpha \vee \beta )$ (Theorem 5, (ii)), we have $I_s^l(\alpha ,\beta )\le \min [h_s^l(\alpha );h_s^l(\beta )].$

Example 5.

Put $\mathcal{M}=\left\{f;f:[0,1]\to [0,1]areBoremeasurable\right\},$ and define in the class $\mathcal{M}$ the operation $\cdot$ as the natural product of fuzzy sets. It is easy to see that $\mathcal{M}$ is a product MV-algebra. Further, we define a state $s:M\to [0,1]$ by the equality $s(f)={\displaystyle {\int }_0^{1}f(x)dx},$ for every $f\in \mathcal{M}.$ Let us consider the pairs $\alpha =(a_1,a_2),$ $\beta =(b_1,b_2),$ where $a_1(x)=x,$ $a_2(x)=1-x,$ $b_1(x)=x^2, b_2(x)=1-x^2,$ $x\in [0,1].$ It is obvious that $\alpha$ and $\beta$ are partitions of $\mathcal{M}.$ Elementary calculations will show that they have the s-state values $\frac{1}{2},\frac{1}{2}$ and $\frac{1}{3},\frac{2}{3}$ of the corresponding elements, respectively, and the logical entropies $h_s^l(\alpha )=\frac{1}{2},$ $h_s^l(\beta )=\frac{4}{9}.$ The partition $\alpha \vee \beta =$ $(a_1\cdot b_1, a_1\cdot b_2, a_2\cdot b_1, a_2\cdot b_2)$ has the s-state values $\frac{1}{4},\frac{1}{4},\frac{1}{12},\frac{5}{12}$ of the corresponding elements, and the logical entropy:

$$h_s^l(\alpha \vee \beta )=1-\left[{(\frac{1}{4})}^2+{(\frac{1}{12})}^2+{(\frac{1}{4})}^2+{(\frac{5}{12})}^2\right]\doteq 0.694444.$$

Simple calculations will show that $h_s^l(\alpha /\beta )\doteq 0.555556-0.305556=0.25.$ By Equation (11) we obtain the logical mutual information of partitions $\alpha$ and $\beta :$

$$I_s^l(\alpha ,\beta )=0.5-0.25=0.25.$$

One can verify that:

$$I_s^l(\alpha ,\beta )=h_s^l(\alpha )+h_s^l(\beta )-h_s^l(\alpha \vee \beta ).$$

Remark 7.

Let us remind that the product MV-algebra presented in the previous example represents an important class of fuzzy sets; it is called a full tribe of fuzzy sets (cf. [21,24,25]).

Theorem 7.

If partitions $\alpha$ and $\beta$ of $(M,\cdot )$ are statistically independent, i.e., $s(a\cdot b)=s(a)\cdot s(b),$ for every $a\in \alpha ,$ $b\in \beta ,$ then:

$$I_s^l(\alpha ,\beta )=h_s^l(\alpha )\cdot h_s^l(\beta ).$$

Proof. 

Let $\alpha =(a_1,\dots ,a_k),$ $\beta =(b_1,\dots ,b_l).$ Using Equations (12) and (4) we obtain:

$$\begin{gathered} I_s^l(\alpha ,\beta )=1-{\displaystyle {\sum }_{i=1}^k{(s(a_i))}^2}+1-{\displaystyle {\sum }_{j=1}^l{(s(b_j))}^2}-1+{\displaystyle {\sum }_{i=1}^k{\displaystyle {\sum }_{j=1}^l{(s(a_i)\cdot s(b_j))}^2}} \\ =\left[1-{\displaystyle {\sum }_{i=1}^k{(s(a_i))}^2}\right]\cdot \left[1-{\displaystyle {\sum }_{j=1}^l{(s(b_j))}^2}\right]=h_s^l(\alpha )\cdot h_s^l(\beta ). \end{gathered}$$

 ☐

As it is known, one of the most significant properties of Shannon entropy is additivity: if partitions $\mathcal{A},\mathcal{B}$ are statistically independent, then $h^S(\mathcal{A}\vee \mathcal{B})=h^S(\mathcal{A})+h^S(\mathcal{B}).$ Here, $\mathcal{A}\vee \mathcal{B}=$ $\left\{A\cap B;A\in \mathcal{A},B\in \mathcal{B}\right\}.$ In the case of logical entropy, the following property applies.

Theorem 8.

If partitions $\alpha$ and $\beta$ of $(M,\cdot )$ are statistically independent, then:

$$1-h_s^l(\alpha \vee \beta )=(1-h_s^l(\alpha ))\cdot (1-h_s^l(\beta )).$$

Proof. 

As a consequence of Theorem 7 and Equation (12), we obtain:

$$\begin{gathered} (1-h_s^l(\alpha ))\cdot (1-h_s^l(\beta ))=1-h_s^l(\alpha )-h_s^l(\beta )+h_s^l(\alpha )\cdot h_s^l(\beta )=1-h_s^l(\alpha )-h_s^l(\beta )+I_s^l(\alpha ,\beta ) \\ =1-h_s^l(\alpha )-h_s^l(\beta )+h_s^l(\alpha )+h_s^l(\beta )-h_s^l(\alpha \vee \beta )=1-h_s^l(\alpha \vee \beta ). \end{gathered}$$

 ☐

In the following two theorems, using the concept of logical conditional mutual information, chain rules for logical mutual information in product MV-algebras are established.

Definition 8.

Let $\alpha ,\beta ,\gamma$ be partitions of $(M,\cdot ).$ The logical conditional mutual information of $\alpha$ and $\beta$ assuming a realization of $\gamma$ is defined by:

$$I_s^l(\alpha ,\beta /\gamma )=h_s^l(\alpha /\gamma )-h_s^l(\alpha /\beta \vee \gamma ).$$

(13)

Remark 8.

It is easy to show that:

$$I_s^l(\alpha ,\beta /\gamma )=I_s^l(\beta ,\alpha /\gamma ).$$

Theorem 9.

For arbitrary partitions $\alpha ,\beta ,\gamma$ of $(M,\cdot ),$ it holds:

$$I_s^l(\alpha \vee \beta ,\gamma )=I_s^l(\alpha ,\gamma )+I_s^l(\beta ,\gamma /\alpha ).$$

Proof. 

Elementary calculations will show that:

$$I_s^l(\alpha ,\gamma )+I_s^l(\beta ,\gamma /\alpha )=h_s^l(\gamma )-h_s^l(\gamma /\alpha )+h_s^l(\gamma /\alpha )-h_s^l(\gamma /\alpha \vee \beta )=I_s^l(\alpha \vee \beta ,\gamma ).$$

 ☐

Theorem 10.

Let ${\alpha }_1,{\alpha }_2,\dots ,{\alpha }_n,\gamma$ be partitions of $(M,\cdot ).$ Then:

$$I_s^l({\vee }_{i=1}^n{\alpha }_i,\gamma )=I_s^l({\alpha }_1,\gamma )+{\displaystyle {\sum }_{i=2}^n{I}_s^l({\alpha }_i,\gamma /{\alpha }_1\vee \dots \vee {\alpha }_{i-1})}.$$

Proof. 

It follows by applying Equations (11), (8), (10), and (13). ☐

Definition 9.

Let $\alpha ,\beta ,\gamma$ be partitions of $(M,\cdot ).$ We say that $\alpha$ and $\gamma$ are conditionally independent given $\beta$ if $I_s^l(\alpha ,\gamma /\beta )=h_s^l(\alpha /\beta )\cdot h_s^l(\gamma /\beta ).$

Theorem 11.

Let $\alpha ,\beta ,\gamma$ be partitions of $(M,\cdot ).$ If $\alpha$ and $\gamma$ are conditionally independent given $\beta ,$ then:

$$I_s^l(\alpha \vee \beta ,\gamma )=I_s^l(\beta ,\gamma )+h_s^l(\alpha /\beta )\cdot h_s^l(\gamma /\beta ).$$

Proof. 

Using Theorem 9 we get:

$$I_s^l(\alpha \vee \beta ,\gamma )=I_s^l(\beta ,\gamma )+I_s^l(\alpha ,\gamma /\beta )=I_s^l(\beta ,\gamma )+h_s^l(\alpha /\beta )\cdot h_s^l(\gamma /\beta ).$$

 ☐

5. Logical Cross Entropy and Logical Divergence in Product MV-Algebras

In this section, we define the notions of logical cross entropy and logical divergence in product MV-algebras. The proposed notions are analogies of the concepts of logical cross entropy and logical divergence introduced by Ellerman in [50]. For illustration, we provide some numerical examples.

Definition 10.

Let $\alpha =(a_1,\dots ,a_n)$ be a partition in a product MV-algebra $(M,\cdot ),$ and $s,t\in S(M).$ We define the logical cross entropy of states $s,t$ with respect to $\alpha$ by the formula:

$$h_{\alpha }^l(s\Vert t)={\displaystyle {\sum }_{i=1}^{n}s(a_i)}(1-t(a_i)).$$

Remark 9.

Since ${\displaystyle {\sum }_{i=1}^{n}s(a_i)}=1,$ we can also write:

$$h_{\alpha }^l(s\Vert t)=1-{\displaystyle {\sum }_{i=1}^{n}s(a_i)t(a_i).}$$

Evidently, the logical cross entropy $h_{\alpha }^l(s$ ‖ $t)$ is symmetric and it is always nonnegative. If states $s,t$ are identical over $\alpha$ (i.e., $s(a_i)=t(a_i),$ for $i=1,2,\dots ,n$ ), then $h_{\alpha }^l(s$ ‖ $t)=h_s^l(\alpha ).$

Definition 11.

Let $\alpha =(a_1,\dots ,a_n)$ be a partition in a product MV-algebra $(M,\cdot ),$ and $s,t\in S(M).$ We define the logical divergence of states $s,t$ with respect to $\alpha$ by the formula:

$$d_{\alpha }^l(s\Vert t)=\frac{1}{2}{\displaystyle {\sum }_{i=1}^n{(s(a_i)-t(a_i))}^2}.$$

Remark 10.

It is evident that $d_{\alpha }^l(s$ ‖ $t)=d_{\alpha }^l(t$ ‖ $s),$ and $d_{\alpha }^l(s$ ‖ $t)\ge 0$ with the equality if and only if the states $s,t$ are identical over $\alpha .$ As in the case of K-L divergence, the logical divergence is not a distance metric because it does not satisfy the triangle inequality (as shown in the example that follows). Notice that its square root (with or without the $\frac{1}{2}$ factor) is a natural distance metric.

Example 6.

Consider any product MV-algebra $(M,\cdot )$ and states $s_1,s_2,s_3$ defined on it. Let $a\in M$ with $s_1(a)=p_1,$ $s_2(a)=p_2,$ $s_3(a)=p_3,$ where $p_1,p_2,p_3\in (0,1).$ Then $s_1(u-a)=1-p_1,$ $s_2(u-a)$ $=1-p_2,$ and $s_3(u-a)=1-p_3.$ Put $p_1=\frac{1}{2},$ $p_2=\frac{1}{3},$ $p_3=\frac{1}{4},$ and consider the partition $\alpha =(a,u-a)$ of $(M,\cdot ).$ Let us calculate:

$$d_{\alpha }^l(s_1\Vert s_2)=\frac{1}{2}{(s_1(a)-s_2(a))}^2+\frac{1}{2}{(s_1(u-a)-s_2(u-a))}^2={(p_1-p_2)}^2=\frac{1}{36}.$$

Analogously:

$$d_{\alpha }^l(s_1\Vert s_3)={(p_1-p_3)}^2=\frac{1}{16},and{d}_{\alpha }^l(s_2\Vert s_3)={(p_2-p_3)}^2=\frac{1}{144}.$$

Evidently,

$$d_{\alpha }^l(s_1\Vert s_3)>d_{\alpha }^l(s_1\Vert s_2)+d_{\alpha }^l(s_2\Vert s_3).$$

The result means that the triangle inequality of the logical divergence in product MV-algebras does not apply, in general.

Theorem 12.

Let $\alpha$ be a partition of a product MV-algebra $(M,\cdot ).$ Then, for every states $s,t$ defined on $(M,\cdot ),$ it holds:

$$d_{\alpha }^l(s\Vert t)=h_{\alpha }^l(s\Vert t)-\frac{1}{2}(h_s^l(\alpha )+h_t^l(\alpha )).$$

Proof. 

Assume that $\alpha =(a_1,\dots ,a_n).$ Let us calculate:

$$h_{\alpha }^l(s\Vert t)-\frac{1}{2}(h_s^l(\alpha )+h_t^l(\alpha ))=1-{\displaystyle {\sum }_{i=1}^{n}s(a_i)t(a_i)-}\frac{1}{2}\left(1-{\displaystyle {\sum }_{i=1}^n{(s(a_i))}^2}\right)-\frac{1}{2}\left(1-{\displaystyle {\sum }_{i=1}^n{(t(a_i))}^2}\right)=\frac{1}{2}{\displaystyle {\sum }_{i=1}^n{(s(a_i)-t(a_i))}^2}=d_{\alpha }^l(s\Vert t).$$

 ☐

Remark 11.

As a simple consequence of the previous theorem and the logical information inequality $d_{\alpha }^l(s$ ‖ $t)\ge 0$ (with the equality if and only if the states $s,t$ are identical over $\alpha$) we get that $h_{\alpha }^l(s$ ‖ $t)\ge$ $\frac{1}{2}(h_s^l(\alpha )+h_t^l(\alpha ))$ with the equality if and only if the states $s,t$ are identical over $\alpha .$

Example 7.

Consider the product MV-algebra $(M,\cdot )$ from Example 4 and the real functions $F_1,F_2$ defined by $F_1(x)=x,F_2(x)=x^2,$ for every $x\in [0,1].$ We define on the product MV-algebra $(M,\cdot )$ two states $s_1,s_2$ by the formulas:

$$s_1(I_A)={\displaystyle {\int }_0^1{I}_A(x)d{F}_1(x)}={\displaystyle {\int }_0^1{I}_A(x)dx},$$

$$s_2(I_A)={\displaystyle {\int }_0^1{I}_A(x)d{F}_2(x)}={\displaystyle {\int }_0^1{I}_A(x)2xdx},$$

for any element $I_A$ of $M.$ The partition $\alpha =\left(I_{[0,\frac{1}{2}]},I_{[\frac{1}{2},1]}\right)$ has the $s_1$-state values $\frac{1}{2},\frac{1}{2}$ of the corresponding elements, and the $s_2$-state values $\frac{1}{4},\frac{3}{4}$ of the corresponding elements. Elementary calculations will show that $h_{s_1}^l(\alpha )=\frac{1}{2},$ and $h_{s_2}^l(\alpha )=\frac{3}{8}$. Further we get:

$$h_{\alpha }^l(s_1\Vert s_2)={\displaystyle {\sum }_{i=1}^2{s}_1(a_i)}(1-s_2(a_i))=\frac{1}{2},and{d}_{\alpha }^l(s_1\Vert s_2)=\frac{1}{2}{\displaystyle {\sum }_{i=1}^2{(s_1(a_i)-s_2(a_i))}^2}=\frac{1}{16}.$$

It is now possible to verify that:

$$d_{\alpha }^l(s_1\Vert s_2)=h_{\alpha }^l(s_1\Vert s_2)-\frac{1}{2}(h_{s_1}^l(\alpha )+h_{s_2}^l(\alpha )),$$

and

$$h_{\alpha }^l(s_1\Vert s_2)\ge \frac{1}{2}(h_{s_1}^l(\alpha )+h_{s_2}^l(\alpha )).$$

6. Conclusions

In [48], the authors introduced the concepts of mutual information and K-L divergence in product MV-algebras and derived the fundamental properties of these quantities. Naturally, the presented theory is based on the Shannon entropy function (Equation (1)). The aim of this paper was to construct a relevant theory on product MV-algebras for the case when the Shannon entropy function is replaced by the logical entropy function (Equation (2)). The main results of the paper are contained in Section 3, Section 4 and Section 5.

In Section 3, we have proposed the concepts of logical entropy and logical conditional entropy of partitions in product MV-algebras and examined their properties. Among others, the concavity of logical entropy has been proved. In Section 4, the notions of logical entropy and logical conditional entropy have been exploited to define the logical mutual information for the examined case of product MV-algebras. We have shown basic properties of these quantities. Moreover, chain rules for logical entropy and logical mutual information for the studied case of product MV-algebras were derived. In the final section, the notions of logical cross entropy and logical divergence in product MV-algebras were proposed. To illustrate the developed theory, several numerical examples are included in the paper.

As already mentioned in Section 4 (see Example 5), an important case of product MV-algebras is the full tribe $\mathcal{M}$ of fuzzy sets. We note that in [21] (see also [24,25]) the entropy of Shannon type on the full tribe $\mathcal{M}$ of fuzzy sets was examined. In a natural way, all results, based on the logical entropy function (2), provided by the theory developed in the paper may be applied also to the case of a full tribe of fuzzy sets.