Dynamic facial expression analysis based on extended spatio-temporal histogram of oriented gradients

Authors:
Seyedehsamaneh Shojaeilangari;Wei-Yun Yau;Jun Li;Eam-Khwang Teoh
Affiliations:
School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Ave., S1-B4c-14, 639798, Singapore;Institute for Infocomm Research, A*STAR, 1 Fusionopolis Way, #21-01 Connexis South, 138632, Singapore;Institute for Infocomm Research, A*STAR, 1 Fusionopolis Way, #21-01 Connexis South, 138632, Singapore;School of Electrical and Electronic Engineering, Nanyang Technological University, 50 Nanyang Ave., S2-B2b-64, 639798, Singapore
Venue:
International Journal of Biometrics
Year:
2014

Citing 25
Cited 0

The Support Vector Method

ICANN '97 Proceedings of the 7th International Conference on Artificial Neural Networks
Bilateral Filtering for Gray and Color Images

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Dynamics of Facial Expression Extracted Automatically from Video

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 5 - Volume 05
Evaluation of Face Resolution for Expression Analysis

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 5 - Volume 05
Active and Dynamic Information Fusion for Facial Expression Understanding from Image Sequences

IEEE Transactions on Pattern Analysis and Machine Intelligence
Histograms of Oriented Gradients for Human Detection

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Scene-based event detection for baseball videos

Journal of Visual Communication and Image Representation
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
A 3-dimensional sift descriptor and its application to action recognition

Proceedings of the 15th international conference on Multimedia
Genetic algorithm-based feature set partitioning for classification problems

Pattern Recognition
Review: A new training method for support vector machines: Clustering k-NN support vector machines

Expert Systems with Applications: An International Journal
Extension of cascaded simple feature based face detection to facial expression recognition

Pattern Recognition Letters
Multiclass support vector machines for diagnosis of erythemato-squamous diseases

Expert Systems with Applications: An International Journal
Recognition of facial expressions using Gabor wavelets and learning vector quantization

Engineering Applications of Artificial Intelligence
Facial expression recognition based on shape and texture

Pattern Recognition
Estimation of behavioral user state based on eye gaze and head pose--application in an e-learning environment

Multimedia Tools and Applications
Facial expression recognition based on Local Binary Patterns: A comprehensive study

Image and Vision Computing
Subtle facial expression recognition using motion magnification

Pattern Recognition Letters
From facial expression to level of interest: a spatio-temporal approach

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Anomalous video event detection using spatiotemporal context

Computer Vision and Image Understanding
Integrated video object tracking with applications in trajectory-based event detection

Journal of Visual Communication and Image Representation
Facial expression recognition using radial encoding of local Gabor features and classifier synthesis

Pattern Recognition
Automatic facial expression recognition using facial animation parameters and multistream HMMs

IEEE Transactions on Information Forensics and Security
Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines

IEEE Transactions on Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Facial expression is crucial for proper analysis of a person's face. It is an indicator of the emotion of a person and thus has attracted the attention of many researchers. In this work, a novel local spatio-temporal descriptor is proposed for motion pattern detection. The proposed feature comprises histogram of 3D gradients and the gradients' variation over time to robustly describe the spatial and temporal information. It also incorporates spatio-temporal pyramid structure to handle different resolution and frame rate. To reduce the dimension of the feature, we applied genetic algorithm for region-based feature selection. We evaluated the performance of our proposed descriptors on facial expression recognition using the Cohn-Kanade CK+ database. The experimental results achieved 96.10% accuracy in detecting six basic emotions. The key advantages of our proposed method are: local and dynamic processing, simple implementation, high performance, and robustness to variation of video resolution or temporal sampling rate.