Next Article in Journal
A Large Deviation Principle and an Expression of the Rate Function for a Discrete Stationary Gaussian Process
Previous Article in Journal
Effect of the Postural Challenge on the Dependence of the Cardiovascular Control Complexity on Age
Article Menu

Export Article

Open AccessArticle
Entropy 2014, 16(12), 6705-6721; doi:10.3390/e16126705

A Representation of the Relative Entropy with Respect to a Diffusion Process in Terms of Its Infinitesimal Generator

INRIA Sophia Antipolis Mediterannee, 2004 Route Des Lucioles, Sophia Antipolis, France
*
Author to whom correspondence should be addressed.
Received: 23 October 2014 / Revised: 17 December 2014 / Accepted: 18 December 2014 / Published: 22 December 2014
(This article belongs to the Section Information Theory)
View Full-Text   |   Download PDF [304 KB, uploaded 24 February 2015]

Abstract

In this paper we derive an integral (with respect to time) representation of the relative entropy (or Kullback–Leibler Divergence) R(μ||P), where μ and P are measures on C([0,T];Rd). The underlying measure P is a weak solution to a martingale problem with continuous coefficients. Our representation is in the form of an integral with respect to its infinitesimal generator. This representation is of use in statistical inference (particularly involving medical imaging). Since R(μ||P) governs the exponential rate of convergence of the empirical measure (according to Sanov’s theorem), this representation is also of use in the numerical and analytical investigation of finite-size effects in systems of interacting diffusions. View Full-Text
Keywords: relative entropy; Kullback–Leibler; diffusion; martingale formulation relative entropy; Kullback–Leibler; diffusion; martingale formulation
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. (CC BY 4.0).

Scifeed alert for new publications

Never miss any articles matching your research from any publisher
  • Get alerts for new papers matching your research
  • Find out the new papers from selected authors
  • Updated daily for 49'000+ journals and 6000+ publishers
  • Define your Scifeed now

SciFeed Share & Cite This Article

MDPI and ACS Style

Faugeras, O.; MacLaurin, J. A Representation of the Relative Entropy with Respect to a Diffusion Process in Terms of Its Infinitesimal Generator. Entropy 2014, 16, 6705-6721.

Show more citation formats Show less citations formats

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top