Next Article in Journal
Using Neighbor Diversity to Detect Fraudsters in Online Auctions
Previous Article in Journal
Guided Self-Organization in a Dynamic Embodied System Based on Attractor Selection Mechanism
Entropy 2014, 16(5), 2611-2628; doi:10.3390/e16052611
Article

Scale-Invariant Divergences for Density Functions

Received: 6 January 2014; in revised form: 26 April 2014 / Accepted: 28 April 2014 / Published: 13 May 2014
View Full-Text   |   Download PDF [214 KB, uploaded 13 May 2014]
Abstract: Divergence is a discrepancy measure between two objects, such as functions, vectors, matrices, and so forth. In particular, divergences defined on probability distributions are widely employed in probabilistic forecasting. As the dissimilarity measure, the divergence should satisfy some conditions. In this paper, we consider two conditions: The first one is the scale-invariance property and the second is that the divergence is approximated by the sample mean of a loss function. The first requirement is an important feature for dissimilarity measures. The divergence will depend on which system of measurements we used to measure the objects. Scale-invariant divergence is transformed in a consistent way when the system of measurements is changed to the other one. The second requirement is formalized such that the divergence is expressed by using the so-called composite score. We study the relation between composite scores and scale-invariant divergences, and we propose a new class of divergences called H¨older divergence that satisfies two conditions above. We present some theoretical properties of H¨older divergence. We show that H¨older divergence unifies existing divergences from the viewpoint of scale-invariance.
Keywords: divergence; scale invariance; composite score; H¨older inequality; reverse H¨older inequality divergence; scale invariance; composite score; H¨older inequality; reverse H¨older inequality
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Export to BibTeX |
EndNote


MDPI and ACS Style

Kanamori, T. Scale-Invariant Divergences for Density Functions. Entropy 2014, 16, 2611-2628.

AMA Style

Kanamori T. Scale-Invariant Divergences for Density Functions. Entropy. 2014; 16(5):2611-2628.

Chicago/Turabian Style

Kanamori, Takafumi. 2014. "Scale-Invariant Divergences for Density Functions." Entropy 16, no. 5: 2611-2628.


Entropy EISSN 1099-4300 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert