Next Article in Journal
Performance of Different Risk Indicators in a Multi-Period Polynomial Portfolio Selection Problem Based on the Credibility Measure
Next Article in Special Issue
Learning Coefficient of Vandermonde Matrix-Type Singularities in Model Selection
Previous Article in Journal
Negentropy Spectrum Decomposition and Its Application in Compound Fault Diagnosis of Rolling Bearing
Previous Article in Special Issue
How the Choice of Distance Measure Influences the Detection of Prior-Data Conflict
Article

Discriminative Structure Learning of Bayesian Network Classifiers from Training Dataset and Testing Instance

by 1,2, 1,2, 3, 1,2,* and 1,2
1
Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
2
College of Computer Science and Technology, Jilin University, Changchun 130012, China
3
Faculty of Science, Engineering & Built Environment, Deakin University, Burwood, VIC 3125, Australia
*
Author to whom correspondence should be addressed.
Entropy 2019, 21(5), 489; https://doi.org/10.3390/e21050489
Received: 12 February 2019 / Revised: 29 April 2019 / Accepted: 6 May 2019 / Published: 13 May 2019
(This article belongs to the Special Issue Bayesian Inference and Information Theory)
Over recent decades, the rapid growth in data makes ever more urgent the quest for highly scalable Bayesian networks that have better classification performance and expressivity (that is, capacity to respectively describe dependence relationships between attributes in different situations). To reduce the search space of possible attribute orders, k-dependence Bayesian classifier (KDB) simply applies mutual information to sort attributes. This sorting strategy is very efficient but it neglects the conditional dependencies between attributes and is sub-optimal. In this paper, we propose a novel sorting strategy and extend KDB from a single restricted network to unrestricted ensemble networks, i.e., unrestricted Bayesian classifier (UKDB), in terms of Markov blanket analysis and target learning. Target learning is a framework that takes each unlabeled testing instance P as a target and builds a specific Bayesian model Bayesian network classifiers (BNC) P to complement BNC T learned from training data T . UKDB respectively introduced UKDB P and UKDB T to flexibly describe the change in dependence relationships for different testing instances and the robust dependence relationships implicated in training data. They both use UKDB as the base classifier by applying the same learning strategy while modeling different parts of the data space, thus they are complementary in nature. The extensive experimental results on the Wisconsin breast cancer database for case study and other 10 datasets by involving classifiers with different structure complexities, such as Naive Bayes (0-dependence), Tree augmented Naive Bayes (1-dependence) and KDB (arbitrary k-dependence), prove the effectiveness and robustness of the proposed approach. View Full-Text
Keywords: Bayesian network classifiers; Markov blanket; target learning Bayesian network classifiers; Markov blanket; target learning
Show Figures

Figure 1

MDPI and ACS Style

Wang, L.; Liu, Y.; Mammadov, M.; Sun, M.; Qi, S. Discriminative Structure Learning of Bayesian Network Classifiers from Training Dataset and Testing Instance. Entropy 2019, 21, 489. https://doi.org/10.3390/e21050489

AMA Style

Wang L, Liu Y, Mammadov M, Sun M, Qi S. Discriminative Structure Learning of Bayesian Network Classifiers from Training Dataset and Testing Instance. Entropy. 2019; 21(5):489. https://doi.org/10.3390/e21050489

Chicago/Turabian Style

Wang, Limin, Yang Liu, Musa Mammadov, Minghui Sun, and Sikai Qi. 2019. "Discriminative Structure Learning of Bayesian Network Classifiers from Training Dataset and Testing Instance" Entropy 21, no. 5: 489. https://doi.org/10.3390/e21050489

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Back to TopTop