Entropy 2013, 15(12), 5439-5463; doi:10.3390/e15125439
Article

Consistency and Generalization Bounds for Maximum Entropy Density Estimation

1 Kno.e.sis Center, Department of Computer Science and Engineering, Wright State University, Dayton, OH 45435, USA 2 Department of Computing Science, University of Alberta, Edmonton, Alberta T6G 2E8, Canada 3 Visa Inc., San Francisco, CA 94128, USA
* Author to whom correspondence should be addressed.
Received: 9 July 2013; in revised form: 13 November 2013 / Accepted: 3 December 2013 / Published: 9 December 2013
(This article belongs to the Special Issue Maximum Entropy and Bayes Theorem)
PDF Full-text Download PDF Full-Text [318 KB, uploaded 9 December 2013 13:31 CET]
Abstract: We investigate the statistical properties of maximum entropy density estimation, both for the complete data case and the incomplete data case. We show that under certain assumptions, the generalization error can be bounded in terms of the complexity of the underlying feature functions. This allows us to establish the universal consistency of maximum entropy density estimation.
Keywords: maximum entropy principle; density estimation; generalization bound; consistency

Article Statistics

Load and display the download statistics.

Citations to this Article

Cite This Article

MDPI and ACS Style

Wang, S.; Greiner, R.; Wang, S. Consistency and Generalization Bounds for Maximum Entropy Density Estimation. Entropy 2013, 15, 5439-5463.

AMA Style

Wang S, Greiner R, Wang S. Consistency and Generalization Bounds for Maximum Entropy Density Estimation. Entropy. 2013; 15(12):5439-5463.

Chicago/Turabian Style

Wang, Shaojun; Greiner, Russell; Wang, Shaomin. 2013. "Consistency and Generalization Bounds for Maximum Entropy Density Estimation." Entropy 15, no. 12: 5439-5463.

Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert