Rigid and non-rigid face motion tracking by aligning texture maps and stereo 3D models

  • Authors:
  • Fadi Dornaika;Angel D. Sappa

  • Affiliations:
  • Institut Géographique National, 2 avenue Pasteur, 94165 Saint-Mandé, France;Computer Vision Center, Edifici O, Campus UAB, 08193 Bellaterra, Barcelona, Spain

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2007

Quantified Score

Hi-index 0.10

Visualization

Abstract

Accurate rigid and non-rigid tracking of faces is a challenging task in computer vision. Recently, appearance-based 3D face tracking methods have been proposed. These methods can successfully tackle the image variability and drift problems. However, they may fail to provide accurate out-of-plane face motions since they are not very sensitive to out-of-plane motion variations. In this paper, we present a framework for fast and accurate 3D face and facial action tracking. Our proposed framework retains the strengths of both appearance and 3D data-based trackers. We combine an adaptive appearance model with an online stereo-based 3D model. We provide experiments and performance evaluation which show the feasibility and usefulness of the proposed approach.