Next Article in Journal
Entropy Analysis and Image Encryption Application Based on a New Chaotic System Crossing a Cylinder
Previous Article in Journal
Online Signature Analysis for Characterizing Early Stage Alzheimer’s Disease: A Feasibility Study
Open AccessArticle

Upper Bound on the Joint Entropy of Correlated Sources Encoded by Good Lattices

Arizona State University, School of Electrical, Computer and Energy Engineering, Tempe, AZ 85281, USA
*
Author to whom correspondence should be addressed.
Entropy 2019, 21(10), 957; https://doi.org/10.3390/e21100957
Received: 6 August 2019 / Revised: 9 September 2019 / Accepted: 27 September 2019 / Published: 29 September 2019
Lattices provide useful structure for distributed coding of correlated sources. A common lattice encoder construction is to first round an observed sequence to a `fine’ lattice with dither, then produce the result’s modulo to a `coarse’ lattice as the encoding. However, such encodings may be jointly-dependent. A class of upper bounds is established on the conditional entropy-rates of such encodings when sources are correlated and Gaussian and the lattices involved are a from an asymptotically-well-behaved sequence. These upper bounds guarantee existence of a joint–compression stage which can increase encoder efficiency. The bounds exploit the property that the amount of possible values for one encoding collapses when conditioned on other sufficiently informative encodings. The bounds are applied to the scenario of communicating through a many-help-one network in the presence of strong correlated Gaussian interferers, and such a joint–compression stage is seen to compensate for some of the inefficiency in certain simple encoder designs.
Keywords: lattice codes; network information theory; distributed source coding; compressed sensing lattice codes; network information theory; distributed source coding; compressed sensing
Show Figures

Graphical abstract

MDPI and ACS Style

Chapman, C.; Bliss, D.W. Upper Bound on the Joint Entropy of Correlated Sources Encoded by Good Lattices. Entropy 2019, 21, 957.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop