Simultaneous Identity and Expression Recognition Using Face Geometry on Low Dimensional Manifolds

  • Authors:
  • Pedro Martins;Jorge Batista

  • Affiliations:
  • Institute of Systems and Robotics Dep. of Electrical Engineering and Computers, University of Coimbra, Portugal;Institute of Systems and Robotics Dep. of Electrical Engineering and Computers, University of Coimbra, Portugal

  • Venue:
  • IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

A solution for simultaneous identity and expression recognition is proposed. The proposed solution starts by extracting face geometry from input images using Active Appearance Models (AAM). Low dimensional manifolds were then derived using Laplacian EigenMaps resulting in two types of manifolds, one for model identity and the other for expression. Respective multiclass Support Vector Machines (SVM) were trained. The recognition is composed by a two step cascade, where first the identity is predicted and then its associated expression model is used to predict the facial expression. For evaluation proposes a database was build consisting on 6770 images captured from 4 people exhibiting 7 different emotions. The identity overall recognition rate was 96.8%. Facial expression results are identity dependent, and the most expressive individual achieves 76.8% of overall recognition rate.