Next Article in Journal
Maximum Entropy Production as an Inference Algorithm that Translates Physical Assumptions into Macroscopic Predictions: Don’t Shoot the Messenger
Next Article in Special Issue
Fisher Information and Semiclassical Treatments
Previous Article in Journal
On the Structural Non-identifiability of Flexible Branched Polymers
Previous Article in Special Issue
Maximum Entropy Estimation of Transition Probabilities of Reversible Markov Chains
Article Menu

Export Article

Open AccessArticle

A Weighted Generalized Maximum Entropy Estimator with a Data-driven Weight

Department of Agricultural Economics, Texas A&M University, College Station, TX 77843-2124, USA
Entropy 2009, 11(4), 917-930;
Received: 24 September 2009 / Accepted: 16 November 2009 / Published: 26 November 2009
(This article belongs to the Special Issue Maximum Entropy)
PDF [189 KB, uploaded 24 February 2015]


The method of Generalized Maximum Entropy (GME), proposed in Golan, Judge and Miller (1996), is an information-theoretic approach that is robust to multicolinearity problem. It uses an objective function that is the sum of the entropies for coefficient distributions and disturbance distributions. This method can be generalized to the weighted GME (W-GME), where different weights are assigned to the two entropies in the objective function. We propose a data-driven method to select the weights in the entropy objective function. We use the least squares cross validation to derive the optimal weights. MonteCarlo simulations demonstrate that the proposedW-GME estimator is comparable to and often outperforms the conventional GME estimator, which places equal weights on the entropies of coefficient and disturbance distributions. View Full-Text
Keywords: maximum entropy; generalized maximum entropy method; cross validation maximum entropy; generalized maximum entropy method; cross validation
This is an open access article distributed under the Creative Commons Attribution License (CC BY 3.0).

Share & Cite This Article

MDPI and ACS Style

Wu, X. A Weighted Generalized Maximum Entropy Estimator with a Data-driven Weight. Entropy 2009, 11, 917-930.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics



[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top