Human Body Model Acquisition and Tracking Using Voxel Data

  • Authors:

  • Ivana Mikić;Mohan Trivedi;Edward Hunter;Pamela Cosman

  • Affiliations:

  • Q3DM, Inc., 10110 Sorrento Valley Rd., Suite B, San Diego, CA 92121, USA. imikic@q3dm.com;Department of Electrical and Computer Engineering, University of California, San Diego, 9500 Gilman Drive 0434, La Jolla, CA 92093-0434, USA. trivedi@ece.ucsd.edu;Q3DM, Inc., 10110 Sorrento Valley Rd., Suite B, San Diego, CA 92121, USA. ehunter@q3dm.com;Department of Electrical and Computer Engineering, University of California, San Diego, 9500 Gilman Drive 0407, La Jolla, CA 92093-0407, USA. pcosman@code.ucsd.edu

  • Venue:
  • International Journal of Computer Vision
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an integrated system for automatic acquisition of the human body model and motion tracking using input from multiple synchronized video streams. The video frames are segmented and the 3D voxel reconstructions of the human body shape in each frame are computed from the foreground silhouettes. These reconstructions are then used as input to the model acquisition and tracking algorithms.The human body model consists of ellipsoids and cylinders and is described using the twists framework resulting in a non-redundant set of model parameters. Model acquisition starts with a simple body part localization procedure based on template fitting and growing, which uses prior knowledge of average body part shapes and dimensions. The initial model is then refined using a Bayesian network that imposes human body proportions onto the body part size estimates. The tracker is an extended Kalman filter that estimates model parameters based on the measurements made on the labeled voxel data. A voxel labeling procedure that handles large frame-to-frame displacements was designed resulting in very robust tracking performance.Extensive evaluation shows that the system performs very reliably on sequences that include different types of motion such as walking, sitting, dancing, running and jumping and people of very different body sizes, from a nine year old girl to a tall adult male.