Next Article in Journal
Laminar-Turbulent Patterning in Transitional Flows
Next Article in Special Issue
Rate-Distortion Bounds for Kernel-Based Distortion Measures
Previous Article in Journal
Incipient Fault Feature Extraction for Rotating Machinery Based on Improved AR-Minimum Entropy Deconvolution Combined with Variational Mode Decomposition Approach
Previous Article in Special Issue
A Novel Geometric Dictionary Construction Approach for Sparse Representation Based Image Fusion
Article Menu
Issue 7 (July) cover image

Export Article

Open AccessArticle
Entropy 2017, 19(7), 315;

The Expected Missing Mass under an Entropy Constraint

Department of Mathematics, Ben-Gurion University, Beer Sheva 84105, Israel
Department of Computer Science, Ben-Gurion University, Beer Sheva 84105, Israel
Author to whom correspondence should be addressed.
Received: 7 June 2017 / Revised: 20 June 2017 / Accepted: 26 June 2017 / Published: 29 June 2017
(This article belongs to the Special Issue Information Theory in Machine Learning and Data Science)
View Full-Text   |   Download PDF [253 KB, uploaded 29 June 2017]   |  


In Berend and Kontorovich (2012), the following problem was studied: A random sample of size t is taken from a world (i.e., probability space) of size n; bound the expected value of the probability of the set of elements not appearing in the sample (unseen mass) in terms of t and n. Here we study the same problem, where the world may be countably infinite, and the probability measure on it is restricted to have an entropy of at most h. We provide tight bounds on the maximum of the expected unseen mass, along with a characterization of the measures attaining this maximum. View Full-Text
Keywords: missing mass; probability estimate; sampling; entropy missing mass; probability estimate; sampling; entropy

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Share & Cite This Article

MDPI and ACS Style

Berend, D.; Kontorovich, A.; Zagdanski, G. The Expected Missing Mass under an Entropy Constraint. Entropy 2017, 19, 315.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top