Next Article in Journal
Electro-Kinetic Pumping with Slip Irreversibility in Heat Exchange of CSP-Powered Bio-Digester Assemblies
Previous Article in Journal
The Extension of Statistical Entropy Analysis to Chemical Compounds
Entropy 2012, 14(12), 2427-2438; doi:10.3390/e14122427
Article

Implications of the Cressie-Read Family of Additive Divergences for Information Recovery

1,†,*  and 2
Received: 15 October 2012 / Revised: 20 November 2012 / Accepted: 27 November 2012 / Published: 3 December 2012
Download PDF [232 KB, uploaded 24 February 2015]

Abstract

To address the unknown nature of probability-sampling models, in this paper we use information theoretic concepts and the Cressie-Read (CR) family of information divergence measures to produce a flexible family of probability distributions, likelihood functions, estimators, and inference procedures. The usual case in statistical modeling is that the noisy indirect data are observed and known and the sampling model-error distribution-probability space, consistent with the data, is unknown. To address the unknown sampling process underlying the data, we consider a convex combination of two or more estimators derived from members of the flexible CR family of divergence measures and optimize that combination to select an estimator that minimizes expected quadratic loss. Sampling experiments are used to illustrate the finite sample properties of the resulting estimator and the nature of the recovered sampling distribution.
Keywords: conditional moment equations; Cressie-Read divergence; information theoretic methods; minimum power divergence; information functionals conditional moment equations; Cressie-Read divergence; information theoretic methods; minimum power divergence; information functionals
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Share & Cite This Article

Further Mendeley | CiteULike
Export to BibTeX |
EndNote
MDPI and ACS Style

Judge, G.G.; Mittelhammer, R.C. Implications of the Cressie-Read Family of Additive Divergences for Information Recovery. Entropy 2012, 14, 2427-2438.

View more citation formats

Article Metrics

Comments

Citing Articles

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert