Next Article in Journal
Impact of Microgroove Shape on Flat Miniature Heat Pipe Efficiency
Previous Article in Journal
Information-Theoretic Analysis of a Family of Improper Discrete Constellations
Open AccessArticle

Function Analysis of the Euclidean Distance between Probability Distributions

Division of Electronic & Information Communication, Kangwon National University, Samcheok 25913, Korea
Entropy 2018, 20(1), 48;
Received: 20 November 2017 / Revised: 31 December 2017 / Accepted: 8 January 2018 / Published: 11 January 2018
(This article belongs to the Section Information Theory, Probability and Statistics)
Minimization of the Euclidean distance between output distribution and Dirac delta functions as a performance criterion is known to match the distribution of system output with delta functions. In the analysis of the algorithm developed based on that criterion and recursive gradient estimation, it is revealed in this paper that the minimization process of the cost function has two gradients with different functions; one that forces spreading of output samples and the other one that compels output samples to move close to symbol points. For investigation the two functions, each gradient is controlled separately through individual normalization of each gradient with their related input. From the analysis and experimental results, it is verified that one gradient is associated with the role of accelerating initial convergence speed by spreading output samples and the other gradient is related with lowering the minimum mean squared error (MSE) by pulling error samples close together. View Full-Text
Keywords: distribution; recursive; gradient; spreading; functions distribution; recursive; gradient; spreading; functions
Show Figures

Figure 1

MDPI and ACS Style

Kim, N. Function Analysis of the Euclidean Distance between Probability Distributions. Entropy 2018, 20, 48.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

Back to TopTop