Learning and Inferring Image Segmentations using the GBP Typical Cut Algorithm

  • Authors:
  • Noam Shental;Assaf Zomet;Tomer Hertz;Yair Weiss

  • Affiliations:
  • -;-;-;-

  • Venue:
  • ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
  • Year:
  • 2003

Quantified Score

Hi-index 0.06

Visualization

Abstract

Significant progress in image segmentation has beenmade by viewing the problem in the framework of graphpartitioning. In particular, spectral clustering methods suchas "normalized cuts" (ncuts) can efficiently calculate goodsegmentations using eigenvector calculations. However,spectral methods when applied to images with local connectivityoften oversegment homogenous regions. More importantly,they lack a straightforward probabilistic interpretationwhich makes it difficult to automatically set parametersusing training data.In this paper we revisit the typical cut criterion proposedin [1, 5]. We show that computing the typical cut isequivalent to performing inference in an undirected graphicalmodel. This equivalence allows us to use the powerfulmachinery of graphical models for learning and inferringimage segmentations. For inferring segmentations weshow that the generalized belief propagation (GBP) algorithmcan give excellent results with a runtime that is usuallyfaster than the ncut eigensolver. For learning segmentationswe derive a maximum likelihood learning algorithmto learn affinity matrices from labelled datasets. We illustrateboth learning and inference on challenging real andsynthetic images.