Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion Tracking

  • Authors:
  • Kong-Man (German) Cheung;Simon Baker;Takeo Kanade

  • Affiliations:
  • Neven Vision, Santa Monica, USA 90404-3082;The Robotics Institute, Carnegie Mellon University, Pittsburgh, USA 15213;The Robotics Institute, Carnegie Mellon University, Pittsburgh, USA 15213

  • Venue:
  • International Journal of Computer Vision
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

In Part I of this paper we developed the theory and algorithms for performing Shape-From-Silhouette (SFS) across time. In this second part, we show how our temporal SFS algorithms can be used in the applications of human modeling and markerless motion tracking. First we build a system to acquire human kinematic models consisting of precise shape (constructed using the temporal SFS algorithm for rigid objects), joint locations, and body part segmentation (estimated using the temporal SFS algorithm for articulated objects). Once the kinematic models have been built, we show how they can be used to track the motion of the person in new video sequences. This marker-less tracking algorithm is based on the Visual Hull alignment algorithm used in both temporal SFS algorithms and utilizes both geometric (silhouette) and photometric (color) information.