Open AccessThis article is
- freely available
Bias Adjustment for a Nonparametric Entropy Estimator
Department of Mathematics and Statistics, University of North Carolina at Charlotte, 9201 University City Blvd, Charlotte, NC 28223, USA
* Author to whom correspondence should be addressed.
Received: 20 March 2013; in revised form: 8 May 2013 / Accepted: 17 May 2013 / Published: 23 May 2013
Abstract: Zhang in 2012 introduced a nonparametric estimator of Shannon’s entropy, whose bias decays exponentially fast when the alphabet is finite. We propose a methodology to estimate the bias of this estimator. We then use it to construct a new estimator of entropy. Simulation results suggest that this bias adjusted estimator has a significantly lower bias than many other commonly used estimators. We consider both the case when the alphabet is finite and when it is countably infinite.
Keywords: nonparametric entropy estimation; bias
Citations to this Article
Cite This Article
MDPI and ACS Style
Zhang, Z.; Grabchak, M. Bias Adjustment for a Nonparametric Entropy Estimator. Entropy 2013, 15, 1999-2011.
Zhang Z, Grabchak M. Bias Adjustment for a Nonparametric Entropy Estimator. Entropy. 2013; 15(6):1999-2011.
Zhang, Zhiyi; Grabchak, Michael. 2013. "Bias Adjustment for a Nonparametric Entropy Estimator." Entropy 15, no. 6: 1999-2011.