Facial expression recognition using nonrigid motion parameters and shape-from-shading

  • Authors:
  • Fang Liu;Edwin R. Hancock;William A. P. Smith

  • Affiliations:
  • School of Computer Sci. and Tech., Huazhong University of Sci. and Tech.;Department of Computer Science, The University of York;Department of Computer Science, The University of York

  • Venue:
  • CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part II
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a 3D motion based approach to facial expression recognition from video sequences. A non-Lambertian shapefrom-shading (SFS) framework is used to recover 3D facial surfaces. The SFS technique avoids heavy computational requirements normally encountered by using a 3D face model. Then, a parametric motion model and optical flow are employed to obtain the nonrigid motion parameters of surface patches. At first, we obtain uniform motion parameters under the assumptions that motion due to change in expressions is temporally consistent. Then we relax the uniform motion constraint, and obtain temporal motion parameters. The two types of motion parameters are used to train and classify using Adaboost and HMM-based classifier. Experimental results show that temporal motion parameters perform much better than uniform motion parameters, and can be used to efficiently recognize facial expression.