Next Article in Journal
Structural Patterns in Complex Systems Using Multidendrograms
Next Article in Special Issue
The Kalman Filter Revisited Using Maximum Relative Entropy
Previous Article in Journal
Core-Based Dynamic Community Detection in Mobile Social Networks
Previous Article in Special Issue
Objective Bayesianism and the Maximum Entropy Principle
Article Menu

Export Article

Open AccessArticle
Entropy 2013, 15(12), 5439-5463; doi:10.3390/e15125439

Consistency and Generalization Bounds for Maximum Entropy Density Estimation

1
Kno.e.sis Center, Department of Computer Science and Engineering, Wright State University, Dayton, OH 45435, USA
2
Department of Computing Science, University of Alberta, Edmonton, Alberta T6G 2E8, Canada
3
Visa Inc., San Francisco, CA 94128, USA
*
Author to whom correspondence should be addressed.
Received: 9 July 2013 / Revised: 13 November 2013 / Accepted: 3 December 2013 / Published: 9 December 2013
(This article belongs to the Special Issue Maximum Entropy and Bayes Theorem)
View Full-Text   |   Download PDF [318 KB, uploaded 24 February 2015]   |  

Abstract

We investigate the statistical properties of maximum entropy density estimation, both for the complete data case and the incomplete data case. We show that under certain assumptions, the generalization error can be bounded in terms of the complexity of the underlying feature functions. This allows us to establish the universal consistency of maximum entropy density estimation. View Full-Text
Keywords: maximum entropy principle; density estimation; generalization bound; consistency maximum entropy principle; density estimation; generalization bound; consistency
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Wang, S.; Greiner, R.; Wang, S. Consistency and Generalization Bounds for Maximum Entropy Density Estimation. Entropy 2013, 15, 5439-5463.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top