An efficient and scalable algorithm for local Bayesian network structure discovery

  • Authors:
  • Sérgio Rodrigues De Morais;Alex Aussem

  • Affiliations:
  • University of Lyon 1, LIESP Laboratory, Villeurbanne, France;University of Lyon 1, LIESP Laboratory, Villeurbanne, France

  • Venue:
  • ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part III
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an efficient and scalable constraint-based algorithm, called Hybrid Parents and Children (HPC), to learn the parents and children of a target variable in a Bayesian network. Finding those variables is an important first step in many applications including Bayesian network structure learning, dimensionality reduction and feature selection. The algorithm combines ideas from incremental and divide-and-conquer methods in a principled and effective way, while still being sound in the sample limit. Extensive empirical experiments are provided on public synthetic and real-world data sets of various sample sizes. The most noteworthy feature of HPC is its ability to handle large neighborhoods contrary to current CB algorithm proposals. The number of calls to the statistical test, en hence the run-time, is empirically on the order O(n1.09), where n is the number of variables, on the five benchmarks that we considered, and O(n1.21) on a real drug design characterized by 138,351 features.