Dynamic facial expression recognition using longitudinal facial expression atlases

  • Authors:
  • Yimo Guo;Guoying Zhao;Matti Pietikäinen

  • Affiliations:
  • Center for Machine Vision Research, Department of Computer Science, and Engineering, University of Oulu, Finland;Center for Machine Vision Research, Department of Computer Science, and Engineering, University of Oulu, Finland;Center for Machine Vision Research, Department of Computer Science, and Engineering, University of Oulu, Finland

  • Venue:
  • ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a new scheme to formulate the dynamic facial expression recognition problem as a longitudinal atlases construction and deformable groupwise image registration problem. The main contributions of this method include: 1) We model human facial feature changes during the facial expression process by a diffeomorphic image registration framework; 2) The subject-specific longitudinal change information of each facial expression is captured by building an expression growth model; 3) Longitudinal atlases of each facial expression are constructed by performing groupwise registration among all the corresponding expression image sequences of different subjects. The constructed atlases can reflect overall facial feature changes of each expression among the population, and can suppress the bias due to inter-personal variations. The proposed method was extensively evaluated on the Cohn-Kanade, MMI, and Oulu-CASIA VIS dynamic facial expression databases and was compared with several state-of-the-art facial expression recognition approaches. Experimental results demonstrate that our method consistently achieves the highest recognition accuracies among other methods under comparison on all the databases.