- freely available
Bias Adjustment for a Nonparametric Entropy Estimator
AbstractZhang in 2012 introduced a nonparametric estimator of Shannon’s entropy, whose bias decays exponentially fast when the alphabet is finite. We propose a methodology to estimate the bias of this estimator. We then use it to construct a new estimator of entropy. Simulation results suggest that this bias adjusted estimator has a significantly lower bias than many other commonly used estimators. We consider both the case when the alphabet is finite and when it is countably infinite.
Share & Cite This Article
Export to BibTeX | EndNote
MDPI and ACS Style
Zhang, Z.; Grabchak, M. Bias Adjustment for a Nonparametric Entropy Estimator. Entropy 2013, 15, 1999-2011.View more citation formats
Zhang Z, Grabchak M. Bias Adjustment for a Nonparametric Entropy Estimator. Entropy. 2013; 15(6):1999-2011.Chicago/Turabian Style
Zhang, Zhiyi; Grabchak, Michael. 2013. "Bias Adjustment for a Nonparametric Entropy Estimator." Entropy 15, no. 6: 1999-2011.