Feature-assisted dense spatio-temporal reconstruction from binocular sequences

  • Authors:
  • Yihao Zhou;Yan Qiu Chen

  • Affiliations:
  • School of Computer Science, Fudan University, Shanghai, China;School of Computer Science, Fudan University, Shanghai, China

  • Venue:
  • ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, a dynamic surface is represented by a triangle mesh with dense vertices whose 3D positions change over time. These time-varying positions are reconstructed by finding their corresponding projections in the images captured by two calibrated and synchronized video cameras. To achieve accurate dense correspondences across views and frames, we first match sparse feature points and rely on them to provide good initialization and strong constraints in optimizing dense correspondence. Spatio-temporal consistency is utilized in matching both features and image points. Three synergistic constraints, image similarity, epipolar geometry and motion clue, are jointly used to optimize stereo and temporal correspondences simultaneously. Tracking failure due to self-occlusion or large appearance change are automatically handled. Experimental results show that complex shape and motion of dynamic surfaces like fabrics and skin can be successfully reconstructed with the proposed method.