Next Article in Journal
Measures of Morphological Complexity of Gray Matter on Magnetic Resonance Imaging for Control Age Grouping
Previous Article in Journal
Entropy-Assisted Computing of Low-Dissipative Systems
Open AccessArticle

A Novel Approach to Canonical Divergences within Information Geometry

by 1,2,3,* and 4
1
Max Planck Institute for Mathematics in the Sciences, Inselstraße 22, Leipzig 04103 , Germany
2
Faculty of Mathematics and Computer Science, University of Leipzig, PF 100920, Leipzig 04009, Germany
3
Santa Fe Institute, 1399 Hyde Park Road, Santa Fe, NM 87501, USA
4
Laboratory for Mathematical Neuroscience, RIKEN Brain Science Institute, Wako-shi Hirosawa 2-1, Saitama 351-0198, Japan
*
Author to whom correspondence should be addressed.
Academic Editor: Kevin H. Knuth
Entropy 2015, 17(12), 8111-8129; https://doi.org/10.3390/e17127866
Received: 12 October 2015 / Revised: 21 November 2015 / Accepted: 25 November 2015 / Published: 9 December 2015
A divergence function on a manifold M defines a Riemannian metric g and dually coupled affine connections ∇ and ∇ * on M. When M is dually flat, that is flat with respect to ∇ and ∇ * , a canonical divergence is known, which is uniquely determined from ( M , g , ∇ , ∇ * ) . We propose a natural definition of a canonical divergence for a general, not necessarily flat, M by using the geodesic integration of the inverse exponential map. The new definition of a canonical divergence reduces to the known canonical divergence in the case of dual flatness. Finally, we show that the integrability of the inverse exponential map implies the geodesic projection property. View Full-Text
Keywords: information geometry; canonical divergence; relative entropy; α-divergence; α-geodesic; duality; geodesic projection information geometry; canonical divergence; relative entropy; α-divergence; α-geodesic; duality; geodesic projection
Show Figures

Figure 1

MDPI and ACS Style

Ay, N.; Amari, S.-i. A Novel Approach to Canonical Divergences within Information Geometry. Entropy 2015, 17, 8111-8129. https://doi.org/10.3390/e17127866

AMA Style

Ay N, Amari S-i. A Novel Approach to Canonical Divergences within Information Geometry. Entropy. 2015; 17(12):8111-8129. https://doi.org/10.3390/e17127866

Chicago/Turabian Style

Ay, Nihat; Amari, Shun-ichi. 2015. "A Novel Approach to Canonical Divergences within Information Geometry" Entropy 17, no. 12: 8111-8129. https://doi.org/10.3390/e17127866

Find Other Styles

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop