Next Article in Journal
Wavelet Energy and Wavelet Coherence as EEG Biomarkers for the Diagnosis of Parkinson’s Disease-Related Dementia and Alzheimer’s Disease
Previous Article in Journal
Wide Range Multiscale Entropy Changes through Development
Article

Improvement of the k-nn Entropy Estimator with Applications in Systems Biology

by 1,2,* and 3,*
1
Institute of Computer Science Polish Academy of Sciences, Jana Kazimierza Street 5, 01-248 Warsaw, Poland
2
Laboratory of Bioinformatics, Nencki Institute of Experimental Biology Polish Academy of Sciences, Pasteura Street 3, 02-093 Warsaw, Poland
3
Institute of Informatics, University of Warsaw, Banacha Street 2, 02-097 Warsaw, Poland
*
Authors to whom correspondence should be addressed.
Academic Editor: Raúl Alcaraz Martínez
Entropy 2016, 18(1), 13; https://doi.org/10.3390/e18010013
Received: 5 October 2015 / Revised: 8 December 2015 / Accepted: 21 December 2015 / Published: 29 December 2015
(This article belongs to the Section Information Theory, Probability and Statistics)
In this paper, we investigate efficient estimation of differential entropy for multivariate random variables. We propose bias correction for the nearest neighbor estimator, which yields more accurate results in higher dimensions. In order to demonstrate the accuracy of the improvement, we calculated the corrected estimator for several families of random variables. For multivariate distributions, we considered the case of independent marginals and the dependence structure between the marginal distributions described by Gaussian copula. The presented solution may be particularly useful for high dimensional data, like those analyzed in the systems biology field. To illustrate such an application, we exploit differential entropy to define the robustness of biochemical kinetic models. View Full-Text
Keywords: differential entropy; k-NN estimator; bias correction; Gaussian copula; mutual information; sensitivity indices; p53-Mdm2 feedback loop model differential entropy; k-NN estimator; bias correction; Gaussian copula; mutual information; sensitivity indices; p53-Mdm2 feedback loop model
Show Figures

Figure 1

MDPI and ACS Style

Charzyńska, A.; Gambin, A. Improvement of the k-nn Entropy Estimator with Applications in Systems Biology. Entropy 2016, 18, 13. https://doi.org/10.3390/e18010013

AMA Style

Charzyńska A, Gambin A. Improvement of the k-nn Entropy Estimator with Applications in Systems Biology. Entropy. 2016; 18(1):13. https://doi.org/10.3390/e18010013

Chicago/Turabian Style

Charzyńska, Agata, and Anna Gambin. 2016. "Improvement of the k-nn Entropy Estimator with Applications in Systems Biology" Entropy 18, no. 1: 13. https://doi.org/10.3390/e18010013

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop