Abstract
In the paper, by methods of the theory of majorization, the authors establish the Schur m-convexity and Shannon type inequalities for Kapur’s entropy.
MSC:
26A51; 26D15; 26E60; 94A17
1. Introduction and Main Results
Let be a probability vector, that is, for and . The quantity
where, if , we put in the sum, is known as entropy of p, or the Shannon information entropy of p.
Theorem 1
([1] (p. 101)). Let be a probability vector. Then is Schur-concave on . In particular, we have
where .
Let p be a probability vector and . The quantity
is known [2] as Kapur’s entropy of order 1 and type . It is easy to see that
where and . It is easy to see that the inequality holds for each probability vector p. However, the inequality
does not hold for each and each probability vector p. Stolarsky [3] shows that the inequality (1) holds for , where . Hereafter, Clausing [4] proved that if and , then the inequality (1) holds for each probability vector p. Thus, with respect to , the function is not strictly Schur-convex. For more information about this topic, the reader is referred to the papers [2,4,5,6,7,8,9,10,11,12,13,14] and the closely related references therein.
In this paper, we will establish the Schur m-convexity and some Shannon type inequalities for Kapur’s entropy .
Our main results are the following two theorems.
Theorem 2.
Let , , and with for . Then the function is Schur m-concave on for and
with the equality in (2) holding for , where
with for .
Theorem 3.
Let , , and with for .
- 1.
- If and with , then
- 2.
- If and with , or if and , then
where for and is defined by (3).
2. Definitions and Lemmas
For proving our main results, we need several definitions and lemmas below.
It is well known that a function of n variables is said to be symmetric if its value is unchanged for any permutation of its n variables .
Definition 1
([1,15]). Let and .
- 1.
- A tuple x is said to be majorized by y (in symbols ) if for and , where and are rearrangements of x and y in a descending order.
- 2.
- A set is called convex if for each and .
- 3.
- Let . A function is said to be Schur-convex on Ω if on Ω implies . A function φ is said to be Schur-concave on Ω if and only if is Schur-convex.
Definition 2
([16]). Let and .
- 1.
- The set Ω is said to be geometrically convex if for each and .
- 2.
- The function φ is said to be Schur-geometrically convex on Ω if the majorization implies for each .
Definition 3
([17]). Let and .
- 1.
- The set Ω is said to be harmonically convex if for each and .
- 2.
- The function φ is said to be Schur-harmonically convex on Ω if the majorization implies for each .
Definition 4
([18,19,20]). Let A function is said to be Schur m-power convex on Ω if the majorization relation on Ω implies that .
Remark 1.
It is not difficult to see that, when ,
When taking , we derive that , , and in Definition 4. Therefore, we can derive from Definition 4 the Schur-convexity, Schur-geometric convexity, and Schur-harmonic convexity, respectively.
Lemma 1
([1,15,21]). Let be a symmetric convex set with nonempty interior and let be a continuous symmetric function which is differentiable in the interior . Then φ is a Schur-convex function on Ω if and only if
Lemma 2
([18,19,20]). Let be a symmetric set with nonempty interior and let be continuous on Ω and differentiable in . Then φ is Schur m-power convex on Ω if and only if φ is symmetric on Ω such that
and
for .
For more information about various convexity named after Schur, please refer to [22,23,24,25,26,27,28,29,30,31,32,33,34] and closely related references therein.
3. Shannon Type Inequalities for Kapur’s Entropy
Now we are in a position to prove our main results.
Proof of Theorem 2.
Calculating the partial derivatives of function in and yields
and
where and under the condition that any empty sum is understood as null.
Letting in Definition 4 and utilizing Lemma 2 give
Hence, the function is Schur m-concave on for .
For and , we have
Let for . If there exists such that and , that is,
Then, it follows that
Further by virtue of Definition 4, we have
The proof of Theorem 2 is thus complete. □
Proof of Theorem 3.
For all and with , by the easily-understandable inequality
for , we obtain
Let . Then
By Lemma 1, we obtain
where for . Then
- when , the function is increasing on and decreasing on ;
- when , the function is increasing on .
Therefore, by Lemma 1, we find that
- if , the function is Schur-convex on ;
- if , the function is Schur-concave on ;
- if , the function is Schur-concave on .
For with , we have
By Definition 1, we see that
- if and with , then
- if and with , then
- if and , the inequality (5) still holds.
The proof of Theorem 3 is thus complete. □
4. Remarks
Finally we list several remarks on our main results and closely related ones.
Remark 2.
Let , , with for . Since for , from Theorem 2, it follows that
with equality for , where is defined by (3).
Remark 3.
- 1.
- If , we havewith equality for .
- 2.
- If , we have
In particular, when and ,
- 1.
- if , thenwith equality for ;
- 2.
- if , then
Remark 4.
Remark 5.
Under conditions of Theorems 2 and 3, if and with , then
Author Contributions
The authors contributed equally to this work. All authors read and approved the final manuscript.
Funding
This research was supported by National Natural Science Foundation of China (Grant No. 11361038), by Foundation of Research Program of Science and Technology at Universities of Inner Mongolia Autonomous Region (Grant No. NJZZ18154), and by Natural Science Foundation of Inner Mongolia (Grant No. 2018LH01002) in China.
Acknowledgments
The authors are thankful to the anonymous referees for their careful corrections to and valuable comments on the original version of this paper.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Marshall, A.W.; Olkin, I.; Arnold, B.C. Inequalities: Theory of Majorization and Its Applications, 2nd ed.; Springer: New York, NY, USA; Dordrecht, The Netherlands; Heidelberg, Germany; London, UK, 2011. [Google Scholar]
- Kapur, J.N. On some properties of generalised entropies. Indian J. Math. 1967, 9, 427–442. [Google Scholar]
- Stolarsky, K.B. A stronger logarithmic inequality suggested by the entropy inequality. SIAM J. Math. Anal. 1980, 11, 242–247. [Google Scholar] [CrossRef]
- Clausing, A. Type t entropy and majorization. SIAM J. Math. Anal. 1983, 14, 203–208. [Google Scholar] [CrossRef]
- Bebiano, N.; Lemos, R.; da Providência, J. Inequalities for quantum relative entropy. Linear Algebra Its Appl. 2005, 401, 159–172. [Google Scholar] [CrossRef]
- Blachman, N.M. The convolution inequality for entropy powers. IEEE Trans. Inf. Theory 1965, IT-11, 267–271. [Google Scholar] [CrossRef]
- Bobkov, S.G.; Chistyakov, G.P. Entropy power inequality for the Rényi entropy. IEEE Trans. Inf. Theory 2015, 61, 708–714. [Google Scholar] [CrossRef]
- Capocelli, R.M.; Taneja, I.J. On some inequalities and generalized entropies: A unified approach. Cybern. Syst. 1985, 16, 341–376. [Google Scholar] [CrossRef]
- Cohen, J.E.; Derriennic, Y.; Zbăganu, G. Majorization, monotonicity of relative entropy, and stochastic matrices, Doeblin and Modern Probability (Blaubeuren, 1991). Contemp. Math. 1993, 149, 251–259. [Google Scholar] [CrossRef]
- Furuichi, S.; Minculete, N.; Mitroi, F.-C. Some inequalities on generalized entropies. J. Inequal. Appl. 2012, 2012, 226. [Google Scholar] [CrossRef]
- Kapur, J.N. Some properties of entropy of order α and type β. Proc. Indian Acad. Sci. Sect. A 1969, 69, 201–211. [Google Scholar] [CrossRef]
- Mokshay, M.; Andrew, B. Generalized entropy power inequalities and monotonicity properties of information. IEEE Trans. Inf. Theory 2007, 53, 2317–2329. [Google Scholar] [CrossRef]
- Qi, F.; Lim, D.; Guo, B.-N. Explicit formulas and identities for the Bell polynomials and a sequence of polynomials applied to differential equations. Rev. Real Acad. Cienc. Exactas Fís. Nat. Ser. A Mat. 2019, in press. [Google Scholar] [CrossRef]
- Yao, Y.; Yao, J.-C.; Liou, Y.-C.; Postolache, M. Iterative algorithms for split common fixed points of demicontractive operators without priori knowledge of operator norms. Carpathian J. Math. 2018, 34, 459–466. [Google Scholar]
- Wang, B.Y. Foundations of Majorization Inequalities; Beijing Normal Univ. Press: Beijing, China, 1990. (In Chinese) [Google Scholar]
- Chu, Y.-M.; Zhang, X.-M.; Wang, G.-D. The Schur geometrical convexity of the extended mean values. J. Convex Anal. 2008, 15, 707–718. [Google Scholar]
- Xia, W.F.; Chu, Y.M. Schur-convexity for a class of symmetric functions and its applications. J. Inequal. Appl. 2009, 2009, 493759. [Google Scholar] [CrossRef]
- Yang, Z.-H. Schur power convexity of Gini means. Bull. Korean Math. Soc. 2013, 50, 485–498. [Google Scholar] [CrossRef]
- Yang, Z.-H. Schur power convexity of Stolarsky means. Publ. Math. Debr. 2012, 80, 43–66. [Google Scholar] [CrossRef]
- Yang, Z.-H. Schur power convexity of the Daróczy means. Math. Inequal. Appl. 2013, 16, 751–762. [Google Scholar] [CrossRef]
- Niculescu, C.P.; Persson, L.-E. Convex Functions and Their Applications: A Contemporary Approach, 2nd ed.; CMS Books in Mathematics/Ouvrages de Mathématiques de la SMC; Springer: Cham, Switzerland, 2018. [Google Scholar]
- Qi, F. A note on Schur-convexity of extended mean values. Rocky Mt. J. Math. 2005, 35, 1787–1793. [Google Scholar] [CrossRef]
- Qi, F.; Niu, D.-W.; Guo, B.-N. Some identities for a sequence of unnamed polynomials connected with the Bell polynomials. Rev. Real Acad. Cienc. Exactas Fís. Nat. Ser. A Mat. 2019, in press. [Google Scholar] [CrossRef]
- Qi, F.; Sándor, J.; Dragomir, S.S.; Sofo, A. Notes on the Schur-convexity of the extended mean values. Taiwan. J. Math. 2005, 9, 411–420. [Google Scholar] [CrossRef]
- Qi, F.; Shi, X.-T.; Mahmoud, M.; Liu, F.-F. Schur-convexity of the Catalan–Qi function related to the Catalan numbers. Tbil. Math. J. 2016, 9, 141–150. [Google Scholar] [CrossRef]
- Rovenţa, I. Schur convexity of a class of symmetric functions. Ann. Univ. Craiova Ser. Mat. Inform. 2010, 37, 12–18. [Google Scholar]
- Shi, H.-N.; Jiang, Y.-M.; Jiang, W.-D. Schur-convexity and Schur-geometrically concavity of Gini mean. Comput. Math. Appl. 2009, 57, 266–274. [Google Scholar] [CrossRef]
- Shi, H.-N.; Wu, S.-H.; Qi, F. An alternative note on the Schur-convexity of the extended mean values. Math. Inequal. Appl. 2006, 9, 219–224. [Google Scholar] [CrossRef]
- Shi, H.-N.; Zhang, J. Compositions involving Schur harmonically convex functions. J. Comput. Anal. Appl. 2017, 22, 907–922. [Google Scholar]
- Sun, J.; Sun, Z.-L.; Xi, B.-Y.; Qi, F. Schur-geometric and Schur-harmonic convexity of an integral mean for convex functions. Turk. J. Anal. Number Theory 2015, 3, 87–89. [Google Scholar] [CrossRef]
- Wu, Y.; Qi, F. Schur-harmonic convexity for differences of some means. Analysis 2012, 32, 263–270. [Google Scholar] [CrossRef]
- Wu, Y.; Qi, F.; Shi, H.-N. Schur-harmonic convexity for differences of some special means in two variables. J. Math. Inequal. 2014, 8, 321–330. [Google Scholar] [CrossRef]
- Yao, Y.; Qin, X.; Yao, J.-C. Projection methods for firmly type nonexpansive operators. J. Nonlinear Convex Anal. 2018, 19, 407–415. [Google Scholar]
- Zhang, X.-M. Geometrically Convex Functions; An’hui University Press: Hefei, China, 2004. (In Chinese) [Google Scholar]
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).