Spatio-Temporal Fusion of Multiple View Video Rate 3D Surfaces

  • Authors:
  • Gordon Collins;Adrian Hilton

  • Affiliations:
  • University of Surrey;University of Surrey

  • Venue:
  • 3DIM '05 Proceedings of the Fifth International Conference on 3-D Digital Imaging and Modeling
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

We consider the problem of geometric integration and representation of multiple views of non-rigidly deforming 3D surface geometry captured at video rate. Instead of treating each frame as a separate mesh we present a representation which takes into consideration temporal and spatial coherence in the data where possible. We first segment gross base transformations using correspondence based on a closest point metric and represent these motions as piecewise rigid transformations. The remaining residual is encoded as displacement maps at each frame giving a displacement video. At both these stages occlusions and missing data are interpolated to give a representation which is continuous in space and time. We demonstrate the integration of multiple views for four different non-rigidly deforming scenes: hand, face, cloth and a composite scene. The approach achieves the integration of multiple-view data at different times into one representation which can processed and edited.