Variational probabilistic inference and the QMR-DT network

  • Authors:
  • Tommi S. Jaakkola;Michael I. Jordan

  • Affiliations:
  • Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA;Computer Science Division and Department of Statistics, University of California, Berkeley, CA

  • Venue:
  • Journal of Artificial Intelligence Research
  • Year:
  • 1999

Quantified Score

Hi-index 0.06

Visualization

Abstract

We describe a variational approximation method for efficient inference in large-scale probabilistic models. Variational methods are deterministic procedures that provide approximations to marginal and conditional probabilities of interest. They provide alternatives to approximate inference methods based on stochastic sampling or search. We describe a variational approach to the problem of diagnostic inference in the "Quick Medical Reference" (QMR) network. The QMR network is a large-scale probabilistic graphical model built on statistical and expert knowledge. Exact probabilistic inference is infeasible in this model for all but a small set of cases. We evaluate our variational inference algorithm on a large set of diagnostic test cases, comparing the algorithm to a state-of-the-art stochastic sampling method.