Entropy 2013, 15(6), 1999-2011; doi:10.3390/e15061999

Bias Adjustment for a Nonparametric Entropy Estimator

Department of Mathematics and Statistics, University of North Carolina at Charlotte, 9201 University City Blvd, Charlotte, NC 28223, USA
* Author to whom correspondence should be addressed.
Received: 20 March 2013; in revised form: 8 May 2013 / Accepted: 17 May 2013 / Published: 23 May 2013
(This article belongs to the Special Issue Estimating Information-Theoretic Quantities from Data)
PDF Full-text Download PDF Full-Text [409 KB, uploaded 23 May 2013 13:48 CEST]
Abstract: Zhang in 2012 introduced a nonparametric estimator of Shannon’s entropy, whose bias decays exponentially fast when the alphabet is finite. We propose a methodology to estimate the bias of this estimator. We then use it to construct a new estimator of entropy. Simulation results suggest that this bias adjusted estimator has a significantly lower bias than many other commonly used estimators. We consider both the case when the alphabet is finite and when it is countably infinite.
Keywords: nonparametric entropy estimation; bias

Article Statistics

Load and display the download statistics.

Citations to this Article

Cite This Article

MDPI and ACS Style

Zhang, Z.; Grabchak, M. Bias Adjustment for a Nonparametric Entropy Estimator. Entropy 2013, 15, 1999-2011.

AMA Style

Zhang Z, Grabchak M. Bias Adjustment for a Nonparametric Entropy Estimator. Entropy. 2013; 15(6):1999-2011.

Chicago/Turabian Style

Zhang, Zhiyi; Grabchak, Michael. 2013. "Bias Adjustment for a Nonparametric Entropy Estimator." Entropy 15, no. 6: 1999-2011.

Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert