Multi-scale clustering of frame-to-frame correspondences for motion segmentation

  • Authors:
  • Ralf Dragon;Bodo Rosenhahn;Jörn Ostermann

  • Affiliations:
  • Institut für Informationsverarbeitung, Leibniz Universität Hannover, Germany;Institut für Informationsverarbeitung, Leibniz Universität Hannover, Germany;Institut für Informationsverarbeitung, Leibniz Universität Hannover, Germany

  • Venue:
  • ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an approach for motion segmentation using independently detected keypoints instead of commonly used tracklets or trajectories. This allows us to establish correspondences over non- consecutive frames, thus we are able to handle multiple object occlusions consistently. On a frame-to-frame level, we extend the classical split-and-merge algorithm for fast and precise motion segmentation. Globally, we cluster multiple of these segmentations of different time scales with an accurate estimation of the number of motions. On the standard benchmarks, our approach performs best in comparison to all algorithms which are able to handle unconstrained missing data. We further show that it works on benchmark data with more than 98% of the input data missing. Finally, the performance is evaluated on a mobile-phone-recorded sequence with multiple objects occluded at the same time.