Face tracking and head pose estimation using convolutional neural networks

  • Authors:
  • Stylianos Asteriadis;Kostas Karpouzis;Stefanos Kollias

  • Affiliations:
  • National Technical University of Athens, Greece;National Technical University of Athens, Greece;National Technical University of Athens, Greece

  • Venue:
  • Proceedings of the SSPNET 2nd International Symposium on Facial Analysis and Animation
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In applications where face orientation is necessary, but in unpretending environments in terms of lighting, equipment, resolution, etc, employing local tracking techniques would usually fail to give accurate results, regarding the issue of head pose estimation. However, in a similar manner, holistic techniques require the face to be well aligned with the training data. This pre-assumes correct and accurate face tracking, which is also a challenging issue. Here, we propose a face tracker, adjusted to each person's face chrominance values, and learnt online. Based on the face bounding box, Convolutional Neural Networks (CNNs) are employed, in order to calculate face orientation. CNNs are ideal for cases where a lot of distortions exist in the data, and the proposed architecture only utilizes subsets of classifiers, excluding those corresponding to rotation angles far from the current.