Capturing Subtle Facial Motions in 3D Face Tracking

  • Authors:
  • Zhen Wen;Thomas S. Huang

  • Affiliations:
  • -;-

  • Venue:
  • ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Facial motions produce not only facial feature points motions,but also subtle appearance changes such as wrinklesand shading changes. These subtle changes are importantyet difficult issues for both analysis (tracking) and synthesis(animation). Previous approaches were mostly basedon models learned from extensive training appearance examples.However, the space of all possible facial motionappearance is huge. Thus, it is not feasible to collect samplescovering all possible variations due to lighting conditions,individualities, and head poses. Therefore, it is difficultto adapt such models to new conditions. In this paper,we present an adaptive technique for analyzing subtle facialappearance changes. We propose a new ratio-imagebased appearance feature, which is independent of a person'sface albedo. This feature is used to track face appearancevariations based on exemplars. To adapt the exemplarappearance model to new people and lighting conditions,we develop an online EM-based algorithm. Experimentsshow that the proposed method improves classification resultsin a facial expression recognition task, where a varietyof people and lighting conditions are involved.