Real-time expression recognition from dynamic sequences of 3D facial scans

Authors:
Stefano Berretti;Alberto Del Bimbo;Pietro Pala
Affiliations:
Dipartimento di Sistemi e Informatica, University of Firenze, Firenze, Italy;Dipartimento di Sistemi e Informatica, University of Firenze, Firenze, Italy;Dipartimento di Sistemi e Informatica, University of Firenze, Firenze, Italy
Venue:
EG 3DOR'12 Proceedings of the 5th Eurographics conference on 3D Object Retrieval
Year:
2012

Citing 14
Cited 1

Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes

IEEE Transactions on Pattern Analysis and Machine Intelligence
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
A 3D Facial Expression Database For Facial Behavior Research

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
3D Facial Expression Recognition Based on Primitive Surface Feature Distribution

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Facial Expression Recognition Based on 3D Dynamic Range Model Sequences

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part II
Bosphorus Database for 3D Face Analysis

Biometrics and Identity Management
Automatic facial expression recognition on a single 3D face by exploring shape deformation

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Anthropometric 3D Face Recognition

International Journal of Computer Vision
A Set of Selected SIFT Features for 3D Facial Expression Recognition

ICPR '10 Proceedings of the 2010 20th International Conference on Pattern Recognition
Shape analysis of local facial patches for 3D facial expression recognition

Pattern Recognition
3D facial expression recognition using SIFT descriptors of automatically detected keypoints

The Visual Computer: International Journal of Computer Graphics - Special Issue on 3DOR 2010
Bilinear Models for 3-D Face and Facial Expression Recognition

IEEE Transactions on Information Forensics and Security
Facial expression recognition using 3D facial feature distances

ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition

Automatic facial expression recognition in real-time from dynamic sequences of 3D face scans

The Visual Computer: International Journal of Computer Graphics

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we address the problem of person-independent facial expression recognition in dynamic sequences of 3D face scans. To this end, an original approach is proposed that relies on automatically extracting a set of 3D facial points, and modeling their mutual distances along time. Training an Hidden Markov Model for every prototypical facial expression to be recognized, and combining them to form a multi-class classifier, an average recognition rate of 76.3% on the angry, happy and surprise expressions of the BU-4DFE database has been obtained. Comparison with competitor approaches on the same database shows that our solution is able to obtain effective results with the clear advantage of an implementation that fits to real-time constraints.