An analysis of facial expression recognition under partial facial image occlusion

Authors:
Irene Kotsia;Ioan Buciu;Ioannis Pitas
Affiliations:
Aristotle University of Thessaloniki, Department of Informatics, Box 451, 54124 Thessaloniki, Greece;Aristotle University of Thessaloniki, Department of Informatics, Box 451, 54124 Thessaloniki, Greece;Aristotle University of Thessaloniki, Department of Informatics, Box 451, 54124 Thessaloniki, Greece
Venue:
Image and Vision Computing
Year:
2008

Citing 21
Cited 11

The nature of statistical learning theory

The nature of statistical learning theory
Face Recognition by Elastic Bunch Graph Matching

IEEE Transactions on Pattern Analysis and Machine Intelligence
Classifying Facial Actions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic Classification of Single Facial Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic Analysis of Facial Expressions: The State of the Art

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Face Recognition for Smart Environments

Computer
Logistic Regression, AdaBoost and Bregman Distances

COLT '00 Proceedings of the Thirteenth Annual Conference on Computational Learning Theory
Comparison Between Geometry-Based and Gabor-Wavelets-Based Facial Expression Recognition Using Multi-Layer Perceptron

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Coding Facial Expressions with Gabor Wavelets

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Comprehensive Database for Facial Expression Analysis

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Facial expression recognition from video sequences: temporal and static modeling

Computer Vision and Image Understanding - Special issue on Face recognition
Real time facial expression recognition in video using support vector machines

Proceedings of the 5th international conference on Multimodal interfaces
Gabor-Based Kernel PCA with Fractional Power Polynomial Models for Face Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Erratum: Erratum to "NMF, LNMF, and DNMF modeling of neural receptive fields involved in human facial expression perception" [J. Vis. Commun. Image Rep. 17 (2006) 958-969]

Journal of Visual Communication and Image Representation
Texture and shape information fusion for facial expression and facial action unit recognition

Pattern Recognition
A Novel Discriminant Non-Negative Matrix Factorization Algorithm With Applications to Facial Image Characterization Problems

IEEE Transactions on Information Forensics and Security - Part 2
Face authentication with Gabor information on deformable graphs

IEEE Transactions on Image Processing
Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines

IEEE Transactions on Image Processing
A comparison of methods for multiclass support vector machines

IEEE Transactions on Neural Networks
Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification

IEEE Transactions on Neural Networks

Visual affect recognition

Visual affect recognition
A wavelet-based face recognition system using partial information

ISVC'10 Proceedings of the 6th international conference on Advances in visual computing - Volume Part III
Extraction of the minimum number of Gabor wavelet parameters for the recognition of natural facial expressions

Artificial Life and Robotics
Expression recognition in videos using a weighted component-based feature descriptor

SCIA'11 Proceedings of the 17th Scandinavian conference on Image analysis
Research of robust facial expression recognition under facial occlusion condition

AMT'11 Proceedings of the 7th international conference on Active media technology
Towards a dynamic expression recognition system under facial occlusion

Pattern Recognition Letters
UPM-3D facial expression recognition Database(UPM-3DFE)

PRICAI'12 Proceedings of the 12th Pacific Rim international conference on Trends in Artificial Intelligence
LSTM-Modeling of continuous emotions in an audiovisual affect recognition framework

Image and Vision Computing
Intelligent pixels of interest selection with application to facial expression recognition using multilayer perceptron

Signal Processing
Robust facial expression recognition in the presence of rotation and partial occlusion

Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference
Facial expression recognition based on anatomy

Computer Vision and Image Understanding

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, an analysis of the effect of partial occlusion on facial expression recognition is investigated. The classification from partially occluded images in one of the six basic facial expressions is performed using a method based on Gabor wavelets texture information extraction, a supervised image decomposition method based on Discriminant Non-negative Matrix Factorization and a shape-based method that exploits the geometrical displacement of certain facial features. We demonstrate how partial occlusion affects the above mentioned methods in the classification of the six basic facial expressions, and indicate the way partial occlusion affects human observers when recognizing facial expressions. An attempt to specify which part of the face (left, right, lower or upper region) contains more discriminant information for each facial expression, is also made and conclusions regarding the pairs of facial expressions misclassifications that each type of occlusion introduces, are drawn.