Low cost virtual face performance capture using stereo web cameras

  • Authors:
  • Alexander Woodward;Patrice Delmas;Georgy Gimel'farb;Jorge Marquez

  • Affiliations:
  • Department of Computer Science, The University of Auckland, Auckland, New Zealand;Department of Computer Science, The University of Auckland, Auckland, New Zealand;Department of Computer Science, The University of Auckland, Auckland, New Zealand;Image Analysis Visualization Laboratory, CCADET UNAM, Mexico

  • Venue:
  • PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

A complete system for creating the performance of a virtual character is described. Stereo web-cameras perform marker based motion capture to obtain rigid head motion and non-rigid facial expression motion. Acquired 3D points are then mapped onto a 3D face model with a virtual muscle animation to create face expressions. Muscle inverse kinematics updates muscle contraction parameters based on marker motion to create the character's performance. Advantages of the system are reduced character creation time by using virtual muscles and a dynamic skin model, a novel way of applying markers to a face animation system, and its low cost hardware requirements, capable of running on standard hardware and making it suitable for interactive media in end-user environments.