Segmentation of Dynamic Scenes from Image Intensities

  • Authors:
  • René Vidal;Shankar Sastry

  • Affiliations:
  • -;-

  • Venue:
  • MOTION '02 Proceedings of the Workshop on Motion and Video Computing
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an algebraic geometric approach for segmentingboth static and dynamic scenes from image intensities.We introduce the multibody affine constraint as ageometric relationship between the motion of multiple objectsand the image intensities generated by them. This constraintis satisfied by all the pixels, regardless of the body towhich they belong and regardless of depth discontinuities orperspective effects. We propose a polynomial factorizationtechnique that estimates the number of affine motion modelsas well as their motion parameters in polynomial time.The factorization technique is used to initialize a nonlinearalgorithm that minimizes the algebraic error defined by themultibody affine constraint. Our approach is based solelyon image intensities, hence it does not require feature trackingor correspondences. It is therefore a natural generalizationof the so-called direct methods in single-body structurefrom motion to multiple moving objects. We present simulationand experimental results that validate our approach.