Analysis and interpretation of multiple motions through surface saliency

  • Authors:

  • Mircea Nicolescu;Changki Min;Gérard Medioni

  • Affiliations:

  • Department of Computer Science, University of Nevada, Reno Reno, NV;Integrated Media Systems Center, University of Southern California, Los Angeles, CA;Integrated Media Systems Center, University of Southern California, Los Angeles, CA

  • Venue:
  • SCVMA'04 Proceedings of the First international conference on Spatial Coherence for Visual Motion Analysis
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

The problem of recovering the 3-D camera and scene structure has been intensively studied and is considered well understood. Starting with two images, a process of establishing point correspondences is usually followed by the estimation of epipolar geometry while also rejecting outlier matches, and finally by 3-D structure estimation. However, most existing methods tend to fail in the combined presence of noise and multiple motions, since no single constraint applies to the entire set of matches. Hence, image registration becomes a more challenging problem, as the matching and registration phases become interdependent. We propose a novel approach that decouples the above operations, allowing for separate handling of matching, outlier rejection, grouping and 3-D interpretation. Our method first determines an accurate representation in terms of dense velocities, segmented motion regions and boundaries, by enforcing only the smoothness of image motion, followed by the extraction of 3-D camera and scene geometry.