Attribute Value Weighted Average of One-Dependence Estimators
AbstractOf numerous proposals to improve the accuracy of naive Bayes by weakening its attribute independence assumption, semi-naive Bayesian classifiers which utilize one-dependence estimators (ODEs) have been shown to be able to approximate the ground-truth attribute dependencies; meanwhile, the probability estimation in ODEs is effective, thus leading to excellent performance. In previous studies, ODEs were exploited directly in a simple way. For example, averaged one-dependence estimators (AODE) weaken the attribute independence assumption by directly averaging all of a constrained class of classifiers. However, all one-dependence estimators in AODE have the same weights and are treated equally. In this study, we propose a new paradigm based on a simple, efficient, and effective attribute value weighting approach, called attribute value weighted average of one-dependence estimators (AVWAODE). AVWAODE assigns discriminative weights to different ODEs by computing the correlation between the different root attribute value and the class. Our approach uses two different attribute value weighting measures: the Kullback–Leibler (KL) measure and the information gain (IG) measure, and thus two different versions are created, which are simply denoted by AVWAODE-KL and AVWAODE-IG, respectively. We experimentally tested them using a collection of 36 University of California at Irvine (UCI) datasets and found that they both achieved better performance than some other state-of-the-art Bayesian classifiers used for comparison. View Full-Text
Share & Cite This Article
Yu, L.; Jiang, L.; Wang, D.; Zhang, L. Attribute Value Weighted Average of One-Dependence Estimators. Entropy 2017, 19, 501.
Yu L, Jiang L, Wang D, Zhang L. Attribute Value Weighted Average of One-Dependence Estimators. Entropy. 2017; 19(9):501.Chicago/Turabian Style
Yu, Liangjun; Jiang, Liangxiao; Wang, Dianhong; Zhang, Lungan. 2017. "Attribute Value Weighted Average of One-Dependence Estimators." Entropy 19, no. 9: 501.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.