3D SSD tracking from uncalibrated video

  • Authors:
  • Dana Cobzas;Martin Jagersand

  • Affiliations:
  • INRIA Rhone-Aples, Montbonnot, France;Computing Science, University of Alberta, Edmonton, Canada

  • Venue:
  • SCVMA'04 Proceedings of the First international conference on Spatial Coherence for Visual Motion Analysis
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

In registration-based motion tracking precise pose between a reference template and the current image is determined by warping image patches into the template coordinates and matching pixel-wise intensities. Efficient such algorithms are based on relating spatial and temporal derivatives using numerical optimization algorithms. We extend this approach from planar patches into a formulation where the 3D geometry of a scene is both estimated from uncalibrated video and used in the tracking of the same video sequence. Experimentally we compare convergence and accuracy of our uncalibrated 3D tracking to previous approaches. Notably, the 3D algorithm can successfully track over significantly larger pose changes than ones using only planar regions. It also detects occlusions and removes/inserts tracking regions as appropriate in response.