Static topographic modeling for facial expression recognition and analysis
Computer Vision and Image Understanding
Eliciting, capturing and tagging spontaneous facialaffect in autism spectrum disorder
Proceedings of the 9th international conference on Multimodal interfaces
Ontology Based Affective Context Representation
EATIS '07 Proceedings of the 2007 Euro American conference on Telematics and information systems
A Facial Expression Recognition Approach Based on Novel Support Vector Machine Tree
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks, Part III
Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction
Boosted multi-resolution spatiotemporal descriptors for facial expression recognition
Pattern Recognition Letters
Emotion recognition using facial expressions with active appearance models
HCI '08 Proceedings of the Third IASTED International Conference on Human Computer Interaction
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Facial expression recognition on multiple manifolds
Pattern Recognition
Facial expression recognition on hexagonal structure using LBP-based histogram variances
MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
A multimodal database for mimicry analysis
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
EUC'06 Proceedings of the 2006 international conference on Embedded and Ubiquitous Computing
Automatic facial expression recognition using linear and nonlinear holistic spatial analysis
ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
Generalization of a vision-based computational model of mind-reading
ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
SVM classification of neonatal facial images of pain
WILF'05 Proceedings of the 6th international conference on Fuzzy Logic and Applications
Detecting Facial Expressions for Monitoring Patterns of Emotional Behavior
International Journal of Monitoring and Surveillance Technologies Research
Dynamic facial expression analysis based on extended spatio-temporal histogram of oriented gradients
International Journal of Biometrics
Hi-index | 0.00 |
We present a systematic comparison of machine learning methods applied to the problem of fully automatic recognition of facial expressions, including AdaBoost, support vector machines, and linear discriminant analysis. Each video-frame is first scanned in real-time to detect approximately upright-frontal faces. The faces found are scaled into image patches of equal size, convolved with a bank of Gabor energy filters, and then passed to a recognition engine that codes facial expressions into 7 dimensions in real time: neutral, anger, disgust, fear, joy, sadness, surprise. We report results on a series of experiments comparing spatial frequency ranges, feature selection techniques, and recognition engines. Best results were obtained by selecting a subset of Gabor filters using AdaBoost and then training Support Vector Machines on the outputs of the filters selected by AdaBoost. The generalization performance to new subjects for a 7-way forced choice was 93% or more correct on two publicly available datasets, the best performance reported so far on these datasets. Surprisingly, registration of internal facial features was not necessary, even though the face detector does not provide precisely registered images. The outputs of the classifier change smoothly as a function of time and thus can be used for unobtrusive motion capture. We developed an end-to-end system that provides facial expression codes at 24 frames per second and animates a computer generated character. In real-time this expression mirror operates down to resolutions of 16 pixels from eye to eye. We also applied the system to fully automated facial action coding.