Poincaré and Log–Sobolev Inequalities for Mixtures
Abstract
:1. Introduction
2. Poincaré Inequality
3. Log–Sobolev Inequality
4. Examples
4.1. Mixture of Two Gaussian Measures with Equal Covariance Matrix
4.2. Mixture of a Gaussian and Sub-Gaussian Measure
4.3. Mixture of Two Centered Gaussians with Different Variance
4.4. Mixture of Uniform and Gaussian Measure
5. Conclusions
- For mixtures with components that are mutually absolutely continuous and whose tail behavior is mutually controlled in terms of the -distance, Theorems 1 and 2 are very effective.
- If only one of the components is absolutely continuous to the other one with bounded density, then it is still possible to obtain a bound on the Poincaré and log–Sobolev constant. However, the log–Sobolev constant blows up logarithmically in the mixture parameter p approaching 0 or 1. It is shown for specific examples that this blow-up is at least for one limit or not artificial due to the applied method.
- A necessary condition for the finiteness of the -distance between two measures is that at least one of the measures and is absolutely continuous to the other one, which in particular provides a mixture with connected support. This condition is too strong since one can easily decompose a measure into a mixture, where the joint support of the components is a null set. In this case, the present approach would not be helpful, even though the mixture may still satisfy both functional inequalities.
Funding
Acknowledgments
Conflicts of Interest
Appendix A. Bakry–Émery Criterion and Holley–Stroock Perturbation Principle
References
- Chafaï, D.; Malrieu, F. On fine properties of mixtures with respect to concentration of measure and Sobolev type inequalities. Annales de l’Institut Henri Poincaré Probabilités et Statistiques 2010, 46, 72–96. [Google Scholar] [CrossRef] [Green Version]
- Menz, G.; Schlichting, A. Poincaré and logarithmic Sobolev inequalities by decomposition of the energy landscape. Ann. Probab. 2014, 42, 1809–1884. [Google Scholar] [CrossRef] [Green Version]
- Gibbs, A.L.; Su, F.E. On Choosing and Bounding Probability Metrics. Int. Stat. Rev. 2002, 70, 419–435. [Google Scholar] [CrossRef] [Green Version]
- Higuchi, Y.; Yoshida, N. Analytic Conditions and Phase Transition for Ising Models. Unpublished lecture notes in Japanese. 1995. [Google Scholar]
- Diaconis, P.; Saloff-Coste, L. Logarithmic Sobolev inequalities for finite Markov chains. Ann. Appl. Probab. 1996, 6, 695–750. [Google Scholar] [CrossRef]
- Ledoux, M. Logarithmic Sobolev Inequalities for Unbounded Spin Systems Revisited; Séminaire de Probabilités XXXV; Springer: Berlin, Germany, 1999; pp. 167–194. [Google Scholar] [CrossRef]
- Carreira-Perpinan, M.A. Mode-finding for mixtures of Gaussian distributions. IEEE Trans. Pattern Anal. Mach. Intell. 2000, 22, 1318–1323. [Google Scholar] [CrossRef] [Green Version]
- Payne, L.E.; Weinberger, H.F. An optimal Poincaré inequality for convex domains. Arch. Ration. Mech. Anal. 1960, 5, 286–292. [Google Scholar] [CrossRef]
- Bobkov, S.G.; Götze, F. Exponential Integrability and Transportation Cost Related to Logarithmic Sobolev Inequalities. J. Funct. Anal. 1999, 163, 1–28. [Google Scholar] [CrossRef] [Green Version]
- Nurminen, H.; Ardeshiri, T.; Piche, R.; Gustafsson, F. Skew-t Filter and Smoother with Improved Covariance Matrix Approximation. IEEE Trans. Signal Process. 2018, 66, 5618–5633. [Google Scholar] [CrossRef]
- Contreras-Reyes, J.; López Quintero, F.; Yáñez, A. Towards Age Determination of Southern King Crab (Lithodes santolla) Off Southern Chile Using Flexible Mixture Modeling. J. Mar. Sci. Eng. 2018, 6, 157. [Google Scholar] [CrossRef]
- Tasche, D. Exact Fit of Simple Finite Mixture Models. J. Risk Financ. Manag. 2014, 7, 150–164. [Google Scholar] [CrossRef] [Green Version]
- McLachlan, G.; Peel, D. Finite Mixture Models; Wiley Series in Probability and Statistics; John Wiley & Sons, Inc.: Hoboken, NJ, USA, 2000. [Google Scholar] [CrossRef]
- Schlichting, A.; Slowik, M. Poincaré and logarithmic Sobolev constants for metastable Markov chains via capacitary inequalities. arXiv, 2017; arXiv:1705.05135. [Google Scholar]
- Schlichting, A. The Eyring-Kramers Formula for Poincaré and Logarithmic Sobolev Inequalities. Ph.D. Thesis, Universität Leipzig, Leipzig, Germany, 2012. [Google Scholar]
- Kolesnikov, A.V.; Milman, E. Riemannian metrics on convex sets with applications to Poincaré and log–Sobolev inequalities. Calc. Var. Part. Differ. Equ. 2016, 55, 1–36. [Google Scholar] [CrossRef]
- Bakry, D.; Émery, M. Diffusions Hypercontractives; Séminaire de Probabilités, XIX; Springer: Berlin, Germany, 1985; pp. 177–206. [Google Scholar]
- Holley, R.; Stroock, D. Logarithmic Sobolev inequalities and stochastic Ising models. J. Stat. Phys. 1987, 46, 1159–1194. [Google Scholar] [CrossRef] [Green Version]
© 2019 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Schlichting, A. Poincaré and Log–Sobolev Inequalities for Mixtures. Entropy 2019, 21, 89. https://doi.org/10.3390/e21010089
Schlichting A. Poincaré and Log–Sobolev Inequalities for Mixtures. Entropy. 2019; 21(1):89. https://doi.org/10.3390/e21010089
Chicago/Turabian StyleSchlichting, André. 2019. "Poincaré and Log–Sobolev Inequalities for Mixtures" Entropy 21, no. 1: 89. https://doi.org/10.3390/e21010089
APA StyleSchlichting, A. (2019). Poincaré and Log–Sobolev Inequalities for Mixtures. Entropy, 21(1), 89. https://doi.org/10.3390/e21010089