Dynamic ordering-based search algorithm for markov blanket discovery

  • Authors:
  • Yifeng Zeng;Xian He;Yanping Xiang;Hua Mao

  • Affiliations:
  • Department of Computer Science, Aalborg University, Aalborg, Denmark and Department of Computer Science, Uni. of Electronic Sci. and Tech. of China, P.R. China;Department of Computer Science, Aalborg University, Aalborg, Denmark and Department of Computer Science, Uni. of Electronic Sci. and Tech. of China, P.R. China;Department of Computer Science, Aalborg University, Aalborg, Denmark and Department of Computer Science, Uni. of Electronic Sci. and Tech. of China, P.R. China;Department of Computer Science, Aalborg University, Aalborg, Denmark and Department of Computer Science, Uni. of Electronic Sci. and Tech. of China, P.R. China

  • Venue:
  • PAKDD'11 Proceedings of the 15th Pacific-Asia conference on Advances in knowledge discovery and data mining - Volume Part II
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Markov blanket discovery plays an important role in both Bayesian network induction and feature selection for classification tasks. In this paper, we propose the Dynamic Ordering-based Search algorithm (DOS) for learning a Markov blanket of a domain variable from statistical conditional independence tests on data. The new algorithm orders conditional independence tests and updates the ordering immediately after a test is completed. Meanwhile, the algorithm exploits the known independence to avoid unnecessary tests by reducing the set of candidate variables. This results in both efficiency and reliability advantages over the existing algorithms. We theoretically analyze the algorithm on its correctness and empirically compare it with the state-of-the-art algorithm. Experiments show that the new algorithm achieves computational savings of around 40% on multiple benchmarks while securing similar or even better accuracy.