The representational power of discrete bayesian networks

  • Authors:
  • Charles X. Ling;Huajie Zhang

  • Affiliations:
  • Department of Computer Science, The University of Western Ontario London, Ontario N6A 5B7, Canada;Faculty of Computer Science, University of New Brunswick, P.O. Box 4400, Fredericton, NB E3B 5A3, Canada

  • Venue:
  • The Journal of Machine Learning Research
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

One of the most important fundamental properties of Bayesian networks is the representational power, reflecting what kind of functions they can or cannot represent. In this paper, we establish an association between the structural complexity of Bayesian networks and their representational power. We use the maximum number of nodes' parents as the measure for the structural complexity of Bayesian networks, and the maximum XOR contained in a target function as the measure for the function complexity. A representational upper bound is established and proved. Roughly speaking, discrete Bayesian networks with each node having at most k parents cannot represent any function containing (k+1)-XORs. Our theoretical results help us to gain a deeper understanding on the capacities and limitations of Bayesian networks.