Mean field theory for sigmoid belief networks

  • Authors:
  • Lawrence K. Saul;Tommi Jaakkola;Michael I. Jordan

  • Affiliations:
  • Center for Biological and Computational Learning, Massachusetts Institute of Technology, Cambridge, MA;Center for Biological and Computational Learning, Massachusetts Institute of Technology, Cambridge, MA;Center for Biological and Computational Learning, Massachusetts Institute of Technology, Cambridge, MA

  • Venue:
  • Journal of Artificial Intelligence Research
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

We develop a mean field theory for sigmoid belief networks based on ideas from statistical mechanics. Our mean field theory provides a tractable approximation to the true probability distribution in these networks; it also yields a lower bound on the likelihood of evidence. We demonstrate the utility of this framework on a benchmark problem in statistical pattern recognition-the classification of handwritten digits.