Next Article in Journal
A Fuzzy-Based Adaptive Streaming Algorithm for Reducing Entropy Rate of DASH Bitrate Fluctuation to Improve Mobile Quality of Service
Next Article in Special Issue
A Lower Bound on the Differential Entropy of Log-Concave Random Vectors with Applications
Previous Article in Journal
Evaluation of Uncertainties in the Design Process of Complex Mechanical Systems
Article Menu
Issue 9 (September) cover image

Export Article

Open AccessArticle
Entropy 2017, 19(9), 235;

Entropies of Weighted Sums in Cyclic Groups and an Application to Polar Codes

Program in Applied and Computational Mathematics, Princeton University, Princeton, NJ 08544-1000, USA
Department of Electrical Engineering, Princeton University, Princeton, NJ 08544-1000, USA
Department of Mathematical Sciences, University of Delaware, Newark, DE 19716, USA
Department of Electrical Engineering and Computer Science, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
Author to whom correspondence should be addressed.
Received: 14 February 2017 / Revised: 5 April 2017 / Accepted: 5 April 2017 / Published: 7 September 2017
(This article belongs to the Special Issue Entropy and Information Inequalities)
Full-Text   |   PDF [309 KB, uploaded 7 September 2017]   |  


In this note, the following basic question is explored: in a cyclic group, how are the Shannon entropies of the sum and difference of i.i.d. random variables related to each other? For the integer group, we show that they can differ by any real number additively, but not too much multiplicatively; on the other hand, for Z / 3 Z , the entropy of the difference is always at least as large as that of the sum. These results are closely related to the study of more-sums-than-differences (i.e., MSTD) sets in additive combinatorics. We also investigate polar codes for q-ary input channels using non-canonical kernels to construct the generator matrix and present applications of our results to constructing polar codes with significantly improved error probability compared to the canonical construction. View Full-Text
Keywords: entropy; more-sums-than-differences set; polar code entropy; more-sums-than-differences set; polar code

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Abbe, E.; Li, J.; Madiman, M. Entropies of Weighted Sums in Cyclic Groups and an Application to Polar Codes. Entropy 2017, 19, 235.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top