Abstract
The prime purpose of this paper is to provide a refinement of Jensen’s inequality in connection with a positive finite sequence. We deal with the refinement for particular cases and point out the relation between the new result with earlier results of Jensen’s inequality. As results, we obtain refinements of the quasi-arithmetic and power mean inequalities. Finally, several results are obtained in information theory with the help of the main results.
MSC:
26D15; 26A51; 68P30
1. Introduction
The great importance and applications of mathematical inequalities cannot be ignored in almost every field of science, such as information theory [1], engineering [2], qualitative theory of integral, mathematical statistics [3], differential equations [4], and economics [5]. Several mathematicians have taken a great interest in refining, proving, and generalizing numerous mathematical inequalities; due to their rapid developments, mathematical inequalities have been considered an independent field of modern applied analysis. Convexity plays a key role in developments in the field of mathematical inequalities [6,7]. The importance of convexity in the theory of inequalities is well known because some much more useful inequalities that originated from this concept have been created, such as the majorization inequality and Jensen’s, Slater’s, and Sherman’s inequalities [8]. Among these inequalities, the Jensen inequality has a special significance because it produces many other important and classical inequalities, such as the Hölder, Ky-Fan, and AM-GM inequalities, and it includes a great number of applications in several areas of mathematics. The Jensen inequality is expressed as follows [9]:
if is a convex function defined on the interval J, for with . This inequality has been widely applied in many branches of science. In [10], Azar applied some versions of Jensen’s inequality in finance and examined the statistical importance of different Jensen-type inequalities by utilizing the mechanism of simulation of random normal variables. They also showed that Jensen’s inequality guarantees that the predicted utility paradigm is not simply a theoretical or a mathematical problem, but it has a statistical support. Jensen’s inequality has pertinence in every subject of biomathematics that consists of nonlinear processes, and this inequality gives a dynamic mechanism for predicting some direct outcomes of environmental variations in biological systems [11]. In information theory, the non-negativity of Kullback–Leibler divergence, bounds for Shannon entropy, Hellinger distance, Bhattacharyya coefficient, total variation distance, and Jeffrey distance can be obtained by using this inequality [12]. By using the majorization concept, a refinement of the Jensen inequality was given in [13], while some interesting bounds for the Jensen difference with several applications were provided in [14].
Due to the widespread use of this inequality, many mathematicians have taken a keen interest in studying its various aspects. In [15], Steffensen proved the same inequality (1) under relaxed conditions for weights with for and while using a strict condition of monotonicity of the tuple . In 1981, Slater derived a very important inequality for increasing convex function that was related to the Jensen inequality [16], while in 1985, Pečarić [17] proved the same inequality for a convex function without using the monotonicity condition of the function; moreover, a multidimensional version of that inequality was established in [18]. In 2003, Mercer brought to the literature an inequality that was more in line with the Jensen inequality [19]. There are many results that are devoted to the Jensen–Mercer inequality. Niezgoda used the concept of majorization and separable sequences, and they derived a generalization of the Jensen–Mercer inequality [20]. In [21], Dragomir considered some indexing subsets of and constructed functionals associated with indexing sets and convex functions. With the aid of these functionals, a refinement of Jensen’s inequality was derived, which implied the earlier refinement obtained in [22].
This manuscript is organized as follows: In Section 2, a refinement of Jensen’s inequality that is associated with an arbitrary positive sequence and some indexing sets is provided (Theorem 1). The result is elaborated for particular indexing sets (Corollary 1). In Remarks 1 and 2, it is explained that the obtained results can generate the earlier results. In Section 3, the main results will be used to deduce refinements of the quasi-arithmetic and power mean inequalities. In Section 4, we illustrate several applications of the obtained results in information theory.
2. Refinement of Jensen’s Inequality
Before describing the main results, we first give some notations that will be used throughout the paper.
If S is a subset of and for , then , , and .
Our first prime result is as follows.
Theorem 1.
Assume that is a convex function defined on the interval J, for . Then, for arbitrary non-empty proper subsets of , we have
The above inequalities hold in the reverse direction if the function f is concave.
Proof.
We begin to express the left side of Jensen’s inequality as:
Note that
□
Remark 1.
It is important to note that Theorem 1 implies the refinement of Jensen’s inequality given in [21], while the refined inequality can be derived by choosing .
In the upcoming result, we obtain a refined Jensen inequality for particular index sets, which gives the inequality established in [22].
Corollary 1.
Assume that is a convex function defined on the interval J, for . Then, for any , we have
The inequalities in (6) are reversed if the function f is concave.
Remark 2.
In Corollary 1, if , then (6) will become the inequality (2.1) given in [22].
3. Applications for Mean Inequalities
Let and be positive n-tuples and . If then the power mean is defined by:
In particular, if , then we denote the power mean by .
As applications of the main result, we deduce refinements of the power mean inequality.
Corollary 2.
Let . If with and are non-empty proper subsets of , then
Proof.
Let and , . Clearly, . The function will be convex if or . If , then as . If , then and as . In both cases, by using the function , substituting by in (2), and then taking the power , we obtain (8). Similarly, for the case in which , is concave with . Therefore, by using Theorem 1 for the concave function , substituting by , and then taking the power , we deduce (8).
Similarly to the above procedure, we can prove (10) by using the function , and substituting by in Theorem 1.
Let and be positive n-tuples and . If h is a strictly monotone and continuous function, then the quasi-arithmetic mean is defined by:
In particular, if , then we denote the power mean by .
Corollary 3.
Let . If are non-empty proper subsets of and is a convex function, then
The above inequalities hold in the opposite direction if the function is concave.
Proof.
Using (2) for instead of and instead of f, we will obtain the required inequality. □
4. Applications in Information Theory
In order to illustrate applications of the new result in information theory, first, we recall some necessary concepts.
Assume that is a convex function, , and are n-tuples with ; then, the Csiszár f-divergence functional [23] is defined by
We recall the following important notions in information theory [14,24]: Let and be positive n-tuples such that .
Theorem 2.
Let f be a convex function defined on and let be two positive n-tuples. Then, for arbitrary non-empty proper subsets of , we have
Proof.
Using Theorem 1 for and for , we obtain (14). □
Corollary 4.
Let be positive n-tuple such that . Then, for arbitrary non-empty proper subsets of , we have
where represents the number of elements in the set T.
Corollary 5.
Let and be positive n-tuples such that . Then, for arbitrary non-empty proper subsets of , we have
Corollary 6.
If all of the conditions of Corollary 5 hold, then
Corollary 7.
If all of the conditions of Corollary 5 hold, then
Corollary 8.
If all of the assumptions of Corollary 5 hold, then
Corollary 9.
Under the assumptions of Corollary 5, the following inequality holds:
Corollary 10.
Under the assumptions of Corollary 5, the following inequalities hold:
Remark 3.
If we substitute in all of the results presented in this section, we may obtain the results derived in [21]. Furthermore, if we take and , then we may deduce the estimations for the notions in information theory as obtained in [22].
In the remainder of this article, we present applications of the main result for the Zipf–Mandelbrot entropy. Before we get started, we offer some basic information about the Zipf–Mandelbrot entropy.
Zipf’s law was further generalized by Mandelbrot in 1966 [25]. This generalized law is called the Zipf–Mandelbrot law in the literature. The Zipf–Mandelbrot law provides development to account for the low-rank words in a corpus where [26]: , and for particular cases in which , this law becomes Zipf’s law. There are numerous interesting applications of this generalized law in different fields, such as ecological field studies [27], information sciences [28], linguistics [26,29], etc.
The Zipf–Mandelbrot entropy is given by
where , , , and the Zipf-Mandelbrot law is given by:
In the following corollaries, we demonstrate applications of the new result, which provides estimations for the Zipf–Mandelbrot entropy.
Corollary 11.
Let , with . Then, for arbitrary non-empty proper subsets of , the following inequalities hold:
Corollary 12.
If and , then for arbitrary non-empty proper subsets of , the following inequalities hold:
5. Conclusions
Jensen’s inequality is very important in almost every field of science, as this inequality has very fruitful applications. Due to the various applications of Jensen’s inequality, numerous mathematicians have paid considerable attention to refinements, extensions, and generalizations of this inequality. In this work, we considered a positive finite sequence and obtained an interesting refinement of Jensen’s inequality pertaining to some index sets. We also discussed the refinement for particular index sets. Interestingly, the obtained results could generate the earlier refinements of Jensen’s inequality. Moreover, we gave several applications of the main result in information theory and deduced refinements of inequalities for some special means.
Author Contributions
Funding
This work was supported by the Natural Science Foundation of Fujian Province of China under Grant No. 2020J01365, and this work was funded by the Institutional Fund Projects under Grant No. IFPIP:0323-130-1443. The authors gratefully acknowledge the financial support provided by the Ministry of Education and King Abdulaziz University, DSR, Jeddah, Saudi Arabia.
Data Availability Statement
No data were used to support this study.
Acknowledgments
The authors are grateful to the anonymous reviewers for their valuable comments and suggestions on improving the quality of the manuscript.
Conflicts of Interest
The authors declare that they have no competing interest.
References
- Horváth, L.; Khan, K.A.; Pečarić, J. Cyclic refinements of the discrete and integral form of Jensen’s inequality with applications. Analysis 2016, 36, 253–263. [Google Scholar] [CrossRef]
- Cloud, M.J.; Drachman, B.C.; Lebedev, L.P. Inequalities with Applications to Engineering; Springer: Cham, Switzerland; Heidelberg, Germany; New York, NY, USA; Dordrecht, The Netherlands; London, UK, 2014. [Google Scholar]
- Liao, J.G.; Berg, A. Sharpening Jensen’s Inequality. Am. Stat. 2018, 4, 1–4. [Google Scholar] [CrossRef]
- Lakshmikantham, V.; Vatsala, A.S. Theory of Differential and Integral Inequalities with Initial Time Difference and Applications; Springer: Berlin, Germany, 1999. [Google Scholar]
- Lin, Q. Jensen inequality for superlinear expectations. Stat. Probabil. Lett. 2019, 151, 79–83. [Google Scholar] [CrossRef]
- Zhao, T.-H.; Wang, M.-K.; Chu, Y.-M. Concavity and bounds involving generalized elliptic integral of the first kind. J. Math. Inequal. 2021, 15, 701–724. [Google Scholar] [CrossRef]
- Zhao, T.-H.; Wang, M.-K.; Chu, Y.-M. Monotonicity and convexity involving generalized elliptic integral of the first kind. Rev. R. Acad. Cienc. Exactas Fís. Nat. Ser. A Mat. 2021, 115, 46. [Google Scholar] [CrossRef]
- Pečarić, J.; Proschan, F.; Tong, Y.L. Convex Functions, Partial Orderings and Statistical Applications; Academic Press, Inc.: Cambridge, MA, USA, 1992. [Google Scholar]
- Jensen, J.L.W.V. Sur les fonctions convexes et les inegalités entre les valeurs moyennes. Acta Math. 1906, 30, 175–193. [Google Scholar] [CrossRef]
- Azar, S.A. Jensen’s inequality in finance. Int. Adv. Econ. Res. 2008, 14, 433–440. [Google Scholar] [CrossRef]
- Ruel, J.J.; Ayres, M.P. Jensen’s inequality predicts effects of environmental variation. Trends Ecol. Evol. 1999, 14, 361–366. [Google Scholar] [CrossRef]
- Khan, S.; Khan, M.A.; Chu, Y.-M. Converses of the Jensen inequality derived from the Green functions with applications in information theory. Math. Method. Appl. Sci. 2020, 43, 2577–2587. [Google Scholar] [CrossRef]
- Saeed, T.; Khan, M.A.; Ullah, H. Refinements of Jensen’s inequality and applications. AIMS Math. 2022, 7, 5328–5346. [Google Scholar] [CrossRef]
- Ullah, H.; Khan, M.A.; Saeed, T. Determination of bounds for the Jensen gap and its applications. Mathematics 2021, 9, 3132. [Google Scholar] [CrossRef]
- Steffensen, J.F. On certain inequalities and methods of approximation. J. Inst. Actuar. 1919, 51, 274–297. [Google Scholar] [CrossRef]
- Slater, M.L. A companion inequality to Jensen’s inequality. J. Approx. Theory 1981, 32, 160–166. [Google Scholar] [CrossRef]
- Pečarić, J.E. A companion to Jensen-Steffensen’s inequality. J. Approx. Theory 1985, 44, 289–291. [Google Scholar] [CrossRef]
- Pečarić, J.E. A multidimensional generalization of Slater’s inequality. J. Approx. Theory 1985, 44, 292–294. [Google Scholar] [CrossRef]
- Mercer, A.M. A variant of Jensen’s inequality. JIPAM 2003, 4, 73. [Google Scholar]
- Niezgoda, M. A generalization of Mercer’s result on convex functions. Nonlinear Anal. 2009, 71, 2771–2779. [Google Scholar] [CrossRef]
- Dragomir, S.S. A new refinement of Jensen’s inequality in linear spaces with applications. Math. Comput. Model. 2010, 52, 1497–1505. [Google Scholar] [CrossRef]
- Dragomir, S.S. A refinement of Jensen’s inequality with applications for f-divergence measures. Taiwan. J. Math. 2010, 14, 153–164. [Google Scholar] [CrossRef]
- Csiszár, I. Information-type measures of differences of probability distributions and indirect observations. Stud. Sci. Math. Hung. 1967, 2, 299–318. [Google Scholar]
- Pečarić, D.; Pečarić, J.; Rodić, M. About the sharpness of the Jensen inequality. J. Inequal. Appl. 2018, 2018, 337. [Google Scholar] [CrossRef] [PubMed]
- Mandelbrot, B. Information Theory and Psycholinguistics: A Theory of Words Frequencies. In Reading in Mathematical Social Scence; Lazafeld, P., Henry, N., Eds.; MIT Press: Cambridge, MA, USA, 1966. [Google Scholar]
- Montemurro, M.A. Beyond the Zipf-Mandelbrot law in quantitative linguistics. arXiv 2001, arXiv:cond-mat/0104066v2. [Google Scholar] [CrossRef]
- Mouillot, D.; Lepretre, A. Introduction of relative abundance distribution (RAD) indices, estimated from the rank-frequency diagrams (RFD), to assess changes in community diversity. Environ. Monit. Assess. 2000, 63, 279–295. [Google Scholar] [CrossRef]
- Silagadze, Z.K. Citations and the Zipf-Mandelbrot Law. Complex Syst. 1997, 11, 487–499. [Google Scholar]
- Manin, D. Mandelbrot’s Model for Zipf’s Law: Can Mandelbrot’s Model Explain Zipf’s Law for Language. J. Quant. Linguist. 2009, 16, 274–285. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).