Analysis, interpretation, and recognition of facial action units and expressions using neuro-fuzzy modeling

Authors:
Mahmoud Khademi;Mohammad Hadi Kiapour;Mohammad T. Manzuri-Shalmani;Ali A. Kiaei
Affiliations:
DSP Lab, Sharif University of Technology, Tehran, Iran;Institute for Studies in Fundamental Sciences (IPM), Tehran, Iran;DSP Lab, Sharif University of Technology, Tehran, Iran;DSP Lab, Sharif University of Technology, Tehran, Iran
Venue:
ANNPR'10 Proceedings of the 4th IAPR TC3 conference on Artificial Neural Networks in Pattern Recognition
Year:
2010

Citing 10
Cited 0

C4.5: programs for machine learning

C4.5: programs for machine learning
Face Recognition by Elastic Bunch Graph Matching

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic Analysis of Facial Expressions: The State of the Art

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recognizing Action Units for Facial Expression Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Coding Facial Expressions with Gabor Wavelets

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Comprehensive Database for Facial Expression Analysis

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Evaluation of Gabor-Wavelet-Based Facial Action Unit Recognition in Image Sequences of Increasing Complexity

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Two-Dimensional PCA: A New Approach to Appearance-Based Face Representation and Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines

IEEE Transactions on Image Processing
Human expression recognition from motion using a radial basis function network architecture

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper an accurate real-time sequence-based system for representation, recognition, interpretation, and analysis of the facial action units (AUs) and expressions is presented. Our system has the following characteristics: 1) employing adaptive-network-based fuzzy inference systems (ANFIS) and temporal information, we developed a classification scheme based on neuro-fuzzy modeling of the AU intensity, which is robust to intensity variations, 2) using both geometric and appearance-based features, and applying efficient dimension reduction techniques, our system is robust to illumination changes and it can represent the subtle changes as well as temporal information involved in formation of the facial expressions, and 3) by continuous values of intensity and employing top-down hierarchical rule-based classifiers, we can develop accurate human-interpretable AU-to-expression converters. Extensive experiments on Cohn-Kanade database show the superiority of the proposed method, in comparison with support vector machines, hidden Markov models, and neural network classifiers.