Next Article in Journal
Application of Bayesian Networks and Information Theory to Estimate the Occurrence of Mid-Air Collisions Based on Accident Precursors
Previous Article in Journal
Effect of Atomic Size Difference on the Microstructure and Mechanical Properties of High-Entropy Alloys
Open AccessArticle

Semi-Supervised Minimum Error Entropy Principle with Distributed Method

by Baobin Wang 1 and Ting Hu 2,*
1
School of Mathematics and Statistics, South-Central University for Nationalities, Wuhan 430074, China
2
School of Mathematics and Statistics, Wuhan University, Wuhan 430072, China
*
Author to whom correspondence should be addressed.
Entropy 2018, 20(12), 968; https://doi.org/10.3390/e20120968
Received: 26 October 2018 / Revised: 8 December 2018 / Accepted: 10 December 2018 / Published: 14 December 2018
(This article belongs to the Section Information Theory, Probability and Statistics)
The minimum error entropy principle (MEE) is an alternative of the classical least squares for its robustness to non-Gaussian noise. This paper studies the gradient descent algorithm for MEE with a semi-supervised approach and distributed method, and shows that using the additional information of unlabeled data can enhance the learning ability of the distributed MEE algorithm. Our result proves that the mean squared error of the distributed gradient descent MEE algorithm can be minimax optimal for regression if the number of local machines increases polynomially as the total datasize. View Full-Text
Keywords: information theoretical learning; distributed method; MEE algorithm; semi-supervised approach; gradient descent; reproducing kernel Hilbert spaces information theoretical learning; distributed method; MEE algorithm; semi-supervised approach; gradient descent; reproducing kernel Hilbert spaces
Show Figures

Figure 1

MDPI and ACS Style

Wang, B.; Hu, T. Semi-Supervised Minimum Error Entropy Principle with Distributed Method. Entropy 2018, 20, 968.

Show more citation formats Show less citations formats
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop