Entropy 2010, 12(5), 1125-1144; doi:10.3390/e12051125

Nearest Neighbor Estimates of Entropy for Multivariate Circular Distributions

1,3,* email, 1,2, and 2
Received: 26 February 2010; Accepted: 29 April 2010 / Published: 6 May 2010
(This article belongs to the Special Issue Configurational Entropy)
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Abstract: In molecular sciences, the estimation of entropies of molecules is important for the understanding of many chemical and biological processes. Motivated by these applications, we consider the problem of estimating the entropies of circular random vectors and introduce non-parametric estimators based on circular distances between n sample points and their k th nearest neighbors (NN), where k (≤ n – 1) is a fixed positive integer. The proposed NN estimators are based on two different circular distances, and are proven to be asymptotically unbiased and consistent. The performance of one of the circular-distance estimators is investigated and compared with that of the already established Euclidean-distance NN estimator using Monte Carlo samples from an analytic distribution of six circular variables of an exactly known entropy and a large sample of seven internal-rotation angles in the molecule of tartaric acid, obtained by a realistic molecular-dynamics simulation.
Keywords: circular random variables; differential entropy; non-parametric estimation; nearest neighbor; circular distance; molecular simulation
PDF Full-text Download PDF Full-Text [372 KB, uploaded 6 May 2010 09:56 CEST]

Export to BibTeX |

MDPI and ACS Style

Misra, N.; Singh, H.; Hnizdo, V. Nearest Neighbor Estimates of Entropy for Multivariate Circular Distributions. Entropy 2010, 12, 1125-1144.

AMA Style

Misra N, Singh H, Hnizdo V. Nearest Neighbor Estimates of Entropy for Multivariate Circular Distributions. Entropy. 2010; 12(5):1125-1144.

Chicago/Turabian Style

Misra, Neeraj; Singh, Harshinder; Hnizdo, Vladimir. 2010. "Nearest Neighbor Estimates of Entropy for Multivariate Circular Distributions." Entropy 12, no. 5: 1125-1144.

Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert