CiteULike
Facebook
Mendeley
Twitter
This article is- freely available
- re-usable
Entropy 2008, 10(4), 745-756; doi:10.3390/e10040745
Article
An Assessment of Hermite Function Based Approximations of Mutual Information Applied to Independent Component Analysis
C3ID, DSTO, PO Box, Edinburgh, SA 5111, Australia
Received: 23 May 2008 / Accepted: 28 November 2008 / Published: 4 December 2008
(This article belongs to the Special Issue Concepts of Entropy and Their Applications - Papers presented at the Meeting at University of Melbourne, 26 November - 11 December 2007)
Download PDF Full-Text [220 KB, uploaded 4 December 2008 13:44 CET]
Abstract: At the heart of many ICA techniques is a nonparametric estimate of an information measure, usually via nonparametric density estimation, for example, kernel density estimation. While not as popular as kernel density estimators, orthogonal functions can be used for nonparametric density estimation (via a truncated series expansion whose coefficients are calculated from the observed data). While such estimators do not necessarily yield a valid density, which kernel density estimators do, they are faster to calculate than kernel density estimators, in particular for a modified version of Renyi's entropy of order 2. In this paper, we compare the performance of ICA using Hermite series based estimates of Shannon's and Renyi's mutual information, to that of Gaussian kernel based estimates. The comparisons also include ICA using the RADICAL estimate of Shannon's entropy and a FastICA estimate of neg-entropy.
Keywords: ICA; nonparametric estimation; Hermite functions; kernel density estimation
Article Statistics
Click here to load and display the download statistics.Cite This Article
MDPI and ACS Style
Sorensen, J. An Assessment of Hermite Function Based Approximations of Mutual Information Applied to Independent Component Analysis. Entropy 2008, 10, 745-756.
AMA StyleSorensen J. An Assessment of Hermite Function Based Approximations of Mutual Information Applied to Independent Component Analysis. Entropy. 2008; 10(4):745-756.
Chicago/Turabian StyleSorensen, Julian. 2008. "An Assessment of Hermite Function Based Approximations of Mutual Information Applied to Independent Component Analysis." Entropy 10, no. 4: 745-756.