Next Article in Journal
Generalized Maximum Entropy Analysis of the Linear Simultaneous Equations Model
Previous Article in Journal
Autonomous Search for a Diffusive Source in an Unknown Structured Environment
Entropy 2014, 16(2), 814-824; doi:10.3390/e16020814

A Note on the W-S Lower Bound of the MEE Estimation

1,* , 1
, 1
 and 2
Received: 5 November 2013 / Revised: 7 January 2014 / Accepted: 26 January 2014 / Published: 10 February 2014
View Full-Text   |   Download PDF [216 KB, uploaded 24 February 2015]   |   Browse Figures
Abstract: The minimum error entropy (MEE) estimation is concerned with the estimation of a certain random variable (unknown variable) based on another random variable (observation), so that the entropy of the estimation error is minimized. This estimation method may outperform the well-known minimum mean square error (MMSE) estimation especially for non-Gaussian situations. There is an important performance bound on the MEE estimation, namely the W-S lower bound, which is computed as the conditional entropy of the unknown variable given observation. Though it has been known in the literature for a considerable time, up to now there is little study on this performance bound. In this paper, we reexamine the W-S lower bound. Some basic properties of the W-S lower bound are presented, and the characterization of Gaussian distribution using the W-S lower bound is investigated.
Keywords: estimation; entropy; MEE estimation; W-S lower bound estimation; entropy; MEE estimation; W-S lower bound
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |

MDPI and ACS Style

Chen, B.; Wang, G.; Zheng, N.; Principe, J.C. A Note on the W-S Lower Bound of the MEE Estimation. Entropy 2014, 16, 814-824.

AMA Style

Chen B, Wang G, Zheng N, Principe JC. A Note on the W-S Lower Bound of the MEE Estimation. Entropy. 2014; 16(2):814-824.

Chicago/Turabian Style

Chen, Badong; Wang, Guangmin; Zheng, Nanning; Principe, Jose C. 2014. "A Note on the W-S Lower Bound of the MEE Estimation." Entropy 16, no. 2: 814-824.

Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert