Next Article in Journal
Multiscale Information Theory and the Marginal Utility of Information
Next Article in Special Issue
Weak Fault Diagnosis of Wind Turbine Gearboxes Based on MED-LMD
Previous Article in Journal
Peierls–Bogolyubov’s Inequality for Deformed Exponentials
Previous Article in Special Issue
Cauchy Principal Value Contour Integral with Applications
Open AccessArticle

A Novel Distance Metric: Generalized Relative Entropy

by 1,2,*, 1,2, 1,2 and 1,2
College of Computer Science, Inner Mongolia University, Hohhot 010010, China
Inner Mongolia Key Laboratory of Data Mining and Knowledge Engineering, Hohhot 010010, China
Author to whom correspondence should be addressed.
Entropy 2017, 19(6), 269;
Received: 26 May 2017 / Revised: 7 June 2017 / Accepted: 7 June 2017 / Published: 13 June 2017
(This article belongs to the Special Issue Wavelets, Fractals and Information Theory III)
Information entropy and its extension, which are important generalizations of entropy, are currently applied to many research domains. In this paper, a novel generalized relative entropy is constructed to avoid some defects of traditional relative entropy. We present the structure of generalized relative entropy after the discussion of defects in relative entropy. Moreover, some properties of the provided generalized relative entropy are presented and proved. The provided generalized relative entropy is proved to have a finite range and is a finite distance metric. Finally, we predict nucleosome positioning of fly and yeast based on generalized relative entropy and relative entropy respectively. The experimental results show that the properties of generalized relative entropy are better than relative entropy. View Full-Text
Keywords: relative entropy; generalized relative entropy; upper bound; distance metric; adjusted distance relative entropy; generalized relative entropy; upper bound; distance metric; adjusted distance
Show Figures

Figure 1

MDPI and ACS Style

Liu, S.; Lu, M.; Liu, G.; Pan, Z. A Novel Distance Metric: Generalized Relative Entropy. Entropy 2017, 19, 269.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map

Back to TopTop