Exact and Approximate Inference for Annotating Graphs with Structural SVMs

  • Authors:
  • Thoralf Klein;Ulf Brefeld;Tobias Scheffer

  • Affiliations:
  • Max Planck Institute for Computer Science, Saarbrücken, Germany;Machine Learning Group, Technische Universität Berlin, Germany;Max Planck Institute for Computer Science, Saarbrücken, Germany

  • Venue:
  • ECML PKDD '08 Proceedings of the 2008 European Conference on Machine Learning and Knowledge Discovery in Databases - Part I
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Training processes of structured prediction models such as structural SVMs involve frequent computations of the maximum-a-posteriori(MAP) prediction given a parameterized model. For specific output structures such as sequences or trees, MAP estimates can be computed efficiently by dynamic programming algorithms such as the Viterbi algorithm and the CKY parser. However, when the output structures can be arbitrary graphs, exact calculation of the MAP estimate is an NP-complete problem. In this paper, we compare exact inference and approximate inference for labeling graphs. We study the exact junction tree and the approximate loopy belief propagation and sampling algorithms in terms of performance and ressource requirements.