Structure Learning of Bayesian Network Based on Adaptive Thresholding
AbstractDirect dependencies and conditional dependencies in restricted Bayesian network classifiers (BNCs) are two basic kinds of dependencies. Traditional approaches, such as filter and wrapper, have proved to be beneficial to identify non-significant dependencies one by one, whereas the high computational overheads make them inefficient especially for those BNCs with high structural complexity. Study of the distributions of information-theoretic measures provides a feasible approach to identifying non-significant dependencies in batch that may help increase the structure reliability and avoid overfitting. In this paper, we investigate two extensions to the k-dependence Bayesian classifier, MI-based feature selection, and CMI-based dependence selection. These two techniques apply a novel adaptive thresholding method to filter out redundancy and can work jointly. Experimental results on 30 datasets from the UCI machine learning repository demonstrate that adaptive thresholds can help distinguish between dependencies and independencies and the proposed algorithm achieves competitive classification performance compared to several state-of-the-art BNCs in terms of 0–1 loss, root mean squared error, bias, and variance. View Full-Text
Share & Cite This Article
Zhang, Y.; Wang, L.; Duan, Z.; Sun, M. Structure Learning of Bayesian Network Based on Adaptive Thresholding. Entropy 2019, 21, 665.
Zhang Y, Wang L, Duan Z, Sun M. Structure Learning of Bayesian Network Based on Adaptive Thresholding. Entropy. 2019; 21(7):665.Chicago/Turabian Style
Zhang, Yang; Wang, Limin; Duan, Zhiyi; Sun, Minghui. 2019. "Structure Learning of Bayesian Network Based on Adaptive Thresholding." Entropy 21, no. 7: 665.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.