Comparative analysis of search and score metaheuristics for Bayesian network structure learning using node juxtaposition distributions

  • Authors:
  • Yanghui Wu;John McCall;David Corne

  • Affiliations:
  • IDEAS Research Institute, Robert Gordon University, Aberdeen, UK;IDEAS Research Institute, Robert Gordon University, Aberdeen, UK;School of Mathematics and Computer Science, Heriot-Watt University, Edinburgh, UK

  • Venue:
  • PPSN'10 Proceedings of the 11th international conference on Parallel problem solving from nature: Part I
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Learning Bayesian networks from data is an NP-hard problem with important practical applications. Metaheuristic search on the space of node orderings combined with deterministic construction and scoring of a network is a well-established approach. The comparative performance of different search and score algorithms is highly problemdependent and so it is of interest to analyze, for benchmark problems with known structures, the relationship between problem features and algorithm performance. In this paper, we investigate four combinations of search (Genetic Algorithms or Ant Colony Optimization) with scoring (K2 or Chain). We relate node juxtaposition distributions over a number of runs to the known problem structure, the algorithm performance and the detailed algorithmic processes. We observe that, for different reasons, ACO and Chain both focus the search on a narrower range of orderings. This works well when the underlying structure is compatible but poorly otherwise. We conclude by suggesting future directions for research.