Variational motion segmentation with level sets

  • Authors:

  • Thomas Brox;Andrés Bruhn;Joachim Weickert

  • Affiliations:

  • CVPR Group, Department of Computer Science, University of Bonn, Bonn, Germany;Mathematical Image Analysis Group, Faculty of Mathematics and Computer Science, Saarland University, Saarbrücken, Germany;Mathematical Image Analysis Group, Faculty of Mathematics and Computer Science, Saarland University, Saarbrücken, Germany

  • Venue:
  • ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We suggest a variational method for the joint estimation of optic flow and the segmentation of the image into regions of similar motion. It makes use of the level set framework following the idea of motion competition, which is extended to non-parametric motion. Moreover, we automatically determine an appropriate initialization and the number of regions by means of recursive two-phase splits with higher order region models. The method is further extended to the spatiotemporal setting and the use of additional cues like the gray value or color for the segmentation. It need not fear a quantitative comparison to pure optic flow estimation techniques: For the popular Yosemite sequence with clouds we obtain the currently most accurate result. We further uncover a mistake in the ground truth. Coarsely correcting this, we get an average angular error below 1 degree.