Facial feature tracking combining model-based and model-free method

  • Authors:
  • Jianyu Wang;Wen Gao;Shiguang Shan;XiaoPeng Hu

  • Affiliations:
  • Dept. of Comput. Sci., Harbin Inst. of Technol., China;Dept. of Comput. Sci., Harbin Inst. of Technol., China;Center for Autom. Res., Maryland Univ., College Park, MD, USA;Dept. of Electr., Electron. & Comput. Eng., Waseda Univ., Tokyo, Japan

  • Venue:
  • ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 3 (ICME '03) - Volume 03
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a novel facial feature tracker, which integrates model-free and model-based method to reliably track dense facial features with complex non-rigid motions in low quality video sequence. The tracker consists of the mouth motion model part and the enhanced KLT tracker part. There are three key elements in our algorithms: dense facial feature tracking, noise removal with global rank constraints and characteristic non-rigid motion description. Experiments show good results on tracking dense facial features under various expressions, even some facial features have degenerate features.