Next Article in Journal
Using Neighbor Diversity to Detect Fraudsters in Online Auctions
Previous Article in Journal
Guided Self-Organization in a Dynamic Embodied System Based on Attractor Selection Mechanism
Open AccessArticle

Scale-Invariant Divergences for Density Functions

Nagoya University, Furocho, Chikusaku, Nagoya 464-8603, Japan
Entropy 2014, 16(5), 2611-2628;
Received: 6 January 2014 / Revised: 26 April 2014 / Accepted: 28 April 2014 / Published: 13 May 2014
Divergence is a discrepancy measure between two objects, such as functions, vectors, matrices, and so forth. In particular, divergences defined on probability distributions are widely employed in probabilistic forecasting. As the dissimilarity measure, the divergence should satisfy some conditions. In this paper, we consider two conditions: The first one is the scale-invariance property and the second is that the divergence is approximated by the sample mean of a loss function. The first requirement is an important feature for dissimilarity measures. The divergence will depend on which system of measurements we used to measure the objects. Scale-invariant divergence is transformed in a consistent way when the system of measurements is changed to the other one. The second requirement is formalized such that the divergence is expressed by using the so-called composite score. We study the relation between composite scores and scale-invariant divergences, and we propose a new class of divergences called H¨older divergence that satisfies two conditions above. We present some theoretical properties of H¨older divergence. We show that H¨older divergence unifies existing divergences from the viewpoint of scale-invariance. View Full-Text
Keywords: divergence; scale invariance; composite score; H¨older inequality; reverse H¨older inequality divergence; scale invariance; composite score; H¨older inequality; reverse H¨older inequality
MDPI and ACS Style

Kanamori, T. Scale-Invariant Divergences for Density Functions. Entropy 2014, 16, 2611-2628.

Show more citation formats Show less citations formats

Article Access Map by Country/Region

Only visits after 24 November 2015 are recorded.
Back to TopTop