Next Article in Journal
On the Uniqueness Theorem for Pseudo-Additive Entropies
Next Article in Special Issue
Rate-Distortion Region of a Gray–Wyner Model with Side Information
Previous Article in Journal
Thermodynamics, Statistical Mechanics and Entropy
Previous Article in Special Issue
Upper Bounds for the Rate Distortion Function of Finite-Length Data Blocks of Gaussian WSS Sources
Open AccessArticle

Rate Distortion Functions and Rate Distortion Function Lower Bounds for Real-World Sources

Department of Electrical and Computer Engineering, University of California, Santa Barbara, CA 93106-9560, USA
Entropy 2017, 19(11), 604; https://doi.org/10.3390/e19110604
Received: 27 September 2017 / Revised: 3 November 2017 / Accepted: 6 November 2017 / Published: 11 November 2017
(This article belongs to the Special Issue Rate-Distortion Theory and Information Theory)
Although Shannon introduced the concept of a rate distortion function in 1948, only in the last decade has the methodology for developing rate distortion function lower bounds for real-world sources been established. However, these recent results have not been fully exploited due to some confusion about how these new rate distortion bounds, once they are obtained, should be interpreted and should be used in source codec performance analysis and design. We present the relevant rate distortion theory and show how this theory can be used for practical codec design and performance prediction and evaluation. Examples for speech and video indicate exactly how the new rate distortion functions can be calculated, interpreted, and extended. These examples illustrate the interplay between source models for rate distortion theoretic studies and the source models underlying video and speech codec design. Key concepts include the development of composite source models per source realization and the application of conditional rate distortion theory. View Full-Text
Keywords: rate distortion bounds; composite source models; conditional rate distortion theory; video codec performance; speech codec performance rate distortion bounds; composite source models; conditional rate distortion theory; video codec performance; speech codec performance
Show Figures

Figure 1

MDPI and ACS Style

Gibson, J. Rate Distortion Functions and Rate Distortion Function Lower Bounds for Real-World Sources. Entropy 2017, 19, 604.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map

1
Back to TopTop