An integrated approach to learning bayesian networks of rules

  • Authors:
  • Jesse Davis;Elizabeth Burnside;Inês de Castro Dutra;David Page;Vítor Santos Costa

  • Affiliations:
  • Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison;Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison;COPPE/Sistemas, UFRJ, Centro de Tecnologia, Rio de Janeiro, Brasil;Department of Biostatistics and Medical Informatics, University of Wisconsin-Madison;COPPE/Sistemas, UFRJ, Centro de Tecnologia, Rio de Janeiro, Brasil

  • Venue:
  • ECML'05 Proceedings of the 16th European conference on Machine Learning
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Inductive Logic Programming (ILP) is a popular approach for learning rules for classification tasks. An important question is how to combine the individual rules to obtain a useful classifier. In some instances, converting each learned rule into a binary feature for a Bayes net learner improves the accuracy compared to the standard decision list approach [3,4,14]. This results in a two-step process, where rules are generated in the first phase, and the classifier is learned in the second phase. We propose an algorithm that interleaves the two steps, by incrementally building a Bayes net during rule learning. Each candidate rule is introduced into the network, and scored by whether it improves the performance of the classifier. We call the algorithm SAYU for Score As You Use. We evaluate two structure learning algorithms Naïve Bayes and Tree Augmented Naïve Bayes. We test SAYU on four different datasets and see a significant improvement in two out of the four applications. Furthermore, the theories that SAYU learns tend to consist of far fewer rules than the theories in the two-step approach.