Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures
Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1 Hibarigaoka, Tempaku-cho, Toyohashi 441-8580, Japan
Academic Editor: Geert Verdoolaege
Received: 4 May 2017 / Revised: 22 May 2017 / Accepted: 5 June 2017 / Published: 7 June 2017
The explicit form of the rate-distortion function has rarely been obtained, except for few cases where the Shannon lower bound coincides with the rate-distortion function for the entire range of the positive rate. From an information geometrical point of view, the evaluation of the rate-distortion function is achieved by a projection to the mixture family defined by the distortion measure. In this paper, we consider the
-th power distortion measure, and prove that
-generalized Gaussian distribution is the only source that can make the Shannon lower bound tight at the minimum distortion level at zero rate. We demonstrate that the tightness of the Shannon lower bound for
(Laplacian source) and
(Gaussian source) yields upper bounds to the rate-distortion function of power distortion measures with a different power. These bounds evaluate from above the projection of the source distribution to the mixture family of the generalized Gaussian models. Applying similar arguments to
-insensitive distortion measures, we consider the tightness of the Shannon lower bound and derive an upper bound to the distortion-rate function which is accurate at low rates.
This is an open access article distributed under the Creative Commons Attribution License
which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).
Share & Cite This Article
MDPI and ACS Style
Watanabe, K. Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures . Entropy 2017, 19, 262.
Watanabe K. Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures . Entropy. 2017; 19(6):262.
Watanabe, Kazuho. 2017. "Projection to Mixture Families and Rate-Distortion Bounds with Power Distortion Measures ." Entropy 19, no. 6: 262.
Show more citation formats
Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.
[Return to top]
For more information on the journal statistics, click here
Multiple requests from the same IP address are counted as one view.