Next Article in Journal
Next Article in Special Issue
Previous Article in Journal
Previous Article in Special Issue
Entropy 2008, 10(3), 131-149; doi:10.3390/entropy-e10030131
Article

Generalised Exponential Families and Associated Entropy Functions

Received: 26 February 2008; in revised form: 1 July 2008 / Accepted: 14 July 2008 / Published: 16 July 2008
Download PDF [213 KB, uploaded 16 September 2008]
Abstract: A generalised notion of exponential families is introduced. It is based on the variational principle, borrowed from statistical physics. It is shown that inequivalent generalised entropy functions lead to distinct generalised exponential families. The well-known result that the inequality of Cram´er and Rao becomes an equality in the case of an exponential family can be generalised. However, this requires the introduction of escort probabilities.
Keywords: generalised entropy; maximum entropy principle; variational principle; generalised exponential family; Bregman divergence; generalised Fisher information; escort probability. generalised entropy; maximum entropy principle; variational principle; generalised exponential family; Bregman divergence; generalised Fisher information; escort probability.
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |
EndNote


MDPI and ACS Style

Naudts, J. Generalised Exponential Families and Associated Entropy Functions. Entropy 2008, 10, 131-149.

AMA Style

Naudts J. Generalised Exponential Families and Associated Entropy Functions. Entropy. 2008; 10(3):131-149.

Chicago/Turabian Style

Naudts, Jan. 2008. "Generalised Exponential Families and Associated Entropy Functions." Entropy 10, no. 3: 131-149.


Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert