A Model-Selection Framework for Multibody Structure-and-Motion of Image Sequences

  • Authors:
  • Konrad Schindler;David Suter;Hanzi Wang

  • Affiliations:
  • Computer Vision Laboratory, Eidgenössische Technische Hochschule, Zürich, Switzerland 8092;Electrical and Computer Systems Engineering, Monash University, Clayton, Australia 3800;Department of Computer Science, Johns Hopkins University, Baltimore, USA 21218

  • Venue:
  • International Journal of Computer Vision
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Given an image sequence of a scene consisting of multiple rigidly moving objects, multi-body structure-and-motion (MSaM) is the task to segment the image feature tracks into the different rigid objects and compute the multiple-view geometry of each object. We present a framework for multibody structure-and-motion based on model selection. In a recover-and-select procedure, a redundant set of hypothetical scene motions is generated. Each subset of this pool of motion candidates is regarded as a possible explanation of the image feature tracks, and the most likely explanation is selected with model selection. The framework is generic and can be used with any parametric camera model, or with a combination of different models. It can deal with sets of correspondences, which change over time, and it is robust to realistic amounts of outliers. The framework is demonstrated for different camera and scene models.