Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions

Authors:
Guoying Zhao;Matti Pietikainen
Affiliations:
-;IEEE
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2007

Citing 18
Cited 120

Qualitative recognition of motion using temporal texture

CVGIP: Image Understanding - Special issue on purposive, qualitative, active vision
Automatic Analysis of Facial Expressions: The State of the Art

IEEE Transactions on Pattern Analysis and Machine Intelligence
Dynamic Textures

International Journal of Computer Vision
Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns

IEEE Transactions on Pattern Analysis and Machine Intelligence
Comprehensive Database for Facial Expression Analysis

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Motion Characterization from Temporal Co-Occurrences of Local Motion-Based Measures for Video Indexing

ICPR '98 Proceedings of the 14th International Conference on Pattern Recognition-Volume 1 - Volume 1
Facial expression recognition from video sequences: temporal and static modeling

Computer Vision and Image Understanding - Special issue on Face recognition
Motion Recognition Using Nonparametric Image Motion Models Estimated from Temporal and Multiscale Cooccurrence Statistics

IEEE Transactions on Pattern Analysis and Machine Intelligence
Feature Extraction of Temporal Texture Based on Spatiotemporal Motion Trajectory

ICPR '98 Proceedings of the 14th International Conference on Pattern Recognition-Volume 2 - Volume 2
A System Identification Approach for Video-based Face Recognition

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4 - Volume 04
Dynamic Texture Recognition by Spatio-Temporal Multiresolution Histograms

WACV-MOTION '05 Proceedings of the IEEE Workshop on Motion and Video Computing (WACV/MOTION'05) - Volume 2 - Volume 02
Local Binary Pattern Descriptors for Dynamic Texture Recognition

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 02
Face Description with Local Binary Patterns: Application to Face Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
From facial expression to level of interest: a spatio-temporal approach

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Dynamic texture recognition using volume local binary patterns

WDV'05/WDV'06/ICCV'05/ECCV'06 Proceedings of the 2005/2006 international conference on Dynamical vision
Dynamic texture recognition using normal flow and texture regularity

IbPRIA'05 Proceedings of the Second Iberian conference on Pattern Recognition and Image Analysis - Volume Part II
Automatic facial expression recognition using facial animation parameters and multistream HMMs

IEEE Transactions on Information Forensics and Security
Synergizing spatial and temporal texture

IEEE Transactions on Image Processing

Local spatiotemporal descriptors for visual recognition of spoken phrases

Proceedings of the international workshop on Human-centered multimedia
Hybrid-boost learning for multi-pose face detection and facial expression recognition

Pattern Recognition
Texture and shape information fusion for facial expression and facial action unit recognition

Pattern Recognition
Dynamic Human Fatigue Detection Using Feature-Level Fusion

ICISP '08 Proceedings of the 3rd international conference on Image and Signal Processing
Text Particles Multi-band Fusion for Robust Text Detection

ICIAR '08 Proceedings of the 5th international conference on Image Analysis and Recognition
Comparison between 2D and 3D Local Binary Pattern Methods for Characterisation of Three-Dimensional Textures

ICIAR '08 Proceedings of the 5th international conference on Image Analysis and Recognition
Boosting encoded dynamic features for facial expression recognition

Pattern Recognition Letters
Similarity Features for Facial Event Analysis

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Facial expression recognition based on Local Binary Patterns: A comprehensive study

Image and Vision Computing
Pose-Invariant Facial Expression Recognition Using Variable-Intensity Templates

International Journal of Computer Vision
Face recognition across pose: A review

Pattern Recognition
Combining appearance and motion for face and gender recognition from videos

Pattern Recognition
Manifold Learning for Gender Classification from Face Sequences

ICB '09 Proceedings of the Third International Conference on Advances in Biometrics
Dynamic Texture Based Gait Recognition

ICB '09 Proceedings of the Third International Conference on Advances in Biometrics
Boosted multi-resolution spatiotemporal descriptors for facial expression recognition

Pattern Recognition Letters
HOG-Based Decision Tree for Facial Expression Classification

IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
A Comparison of Wavelet Based Spatio-temporal Decomposition Methods for Dynamic Texture Recognition

IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
Multi-band Gradient Component Pattern (MGCP): A New Statistical Feature for Face Recognition

SCIA '09 Proceedings of the 16th Scandinavian Conference on Image Analysis
Weight-Based Facial Expression Recognition from Near-Infrared Video Sequences

SCIA '09 Proceedings of the 16th Scandinavian Conference on Image Analysis
Novel multiclass classifiers based on the minimization of the within-class variance

IEEE Transactions on Neural Networks
Salient feature and reliable classifier selection for facial expression classification

Pattern Recognition
Gabor-based dynamic representation for human fatigue monitoring in facial image sequences

Pattern Recognition Letters
Multi-level Ground Glass Nodule Detection and Segmentation in CT Lung Images

MICCAI '09 Proceedings of the 12th International Conference on Medical Image Computing and Computer-Assisted Intervention: Part II
Lipreading with local spatiotemporal descriptors

IEEE Transactions on Multimedia
Facial-component-based bag of words and PHOG descriptor for facial expression recognition

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor

IEEE Transactions on Image Processing
Learning personal specific facial dynamics for face recognition from videos

AMFG'07 Proceedings of the 3rd international conference on Analysis and modeling of faces and gestures
Dynamic textures for human movement recognition

Proceedings of the ACM International Conference on Image and Video Retrieval
Feature detector and descriptor evaluation in human action recognition

Proceedings of the ACM International Conference on Image and Video Retrieval
A 3D discrete curvelet based method for segmenting dynamic textures

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Dynamic texture synthesis using a spatial temporal descriptor

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Image ratio features for facial expression recognition application

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on game theory
A completed modeling of local binary pattern operator for texture classification

IEEE Transactions on Image Processing
DynTex: A comprehensive database of dynamic textures

Pattern Recognition Letters
Facial expression recognition on multiple manifolds

Pattern Recognition
Applications of a simple characterization of human gait in surveillance

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics - Special issue on gait analysis
Real-time large scale near-duplicate web video retrieval

Proceedings of the international conference on Multimedia
Combining dynamic texture and structural features for speaker identification

Proceedings of the 2nd ACM workshop on Multimedia in forensics, security and intelligence
Maximum margin distance learning for dynamic texture recognition

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part II
Fast dynamic texture detection

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
3D localization of pronuclei of human zygotes using textures from multiple focal planes

MICCAI'10 Proceedings of the 13th international conference on Medical image computing and computer-assisted intervention: Part II
Sign and magnitude of local patterns for image indexing and retrieval

International Journal of Computational Vision and Robotics
Facial expression classification based on local spatiotemporal edge and texture descriptors

Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research
Dynamic soft encoded patterns for facial event analysis

Computer Vision and Image Understanding
Differential optical flow applied to automatic facial expression recognition

Neurocomputing
A temporal latent topic model for facial expression recognition

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
Mixed 2D-3D information for face recognition

Transactions on edutainment V
PLBP: An effective local binary patterns texture descriptor with pyramid representation

Pattern Recognition
Volume local phase quantization for blur-insensitive dynamic texture classification

SCIA'11 Proceedings of the 17th Scandinavian conference on Image analysis
Expression recognition in videos using a weighted component-based feature descriptor

SCIA'11 Proceedings of the 17th Scandinavian conference on Image analysis
Facial expression recognition from near-infrared videos

Image and Vision Computing
Facial expression recognition using radial encoding of local Gabor features and classifier synthesis

Pattern Recognition
Dynamic texture analysis and classification using deterministic partially self-avoiding walks

ACIVS'11 Proceedings of the 13th international conference on Advanced concepts for intelligent vision systems
Recent advances and trends in visual tracking: A review

Neurocomputing
A spatiotemporal context phrase description for general dynamic texture

Proceedings of the Third International Conference on Internet Multimedia Computing and Service
Texture analysis based on saddle points-based BEMD and LBP

CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part II
Survey on LBP based texture descriptors for image classification

Expert Systems with Applications: An International Journal
Dynamic texture reconstruction from sparse codes for unusual event detection in crowded scenes

J-MRE '11 Proceedings of the 2011 joint ACM workshop on Modeling and representing events
Analysis of landmarks in recognition of face expressions

Pattern Recognition and Image Analysis
Local maximum edge binary patterns: A new descriptor for image retrieval and object tracking

Signal Processing
Facial expression recognition using spatiotemporal boosted discriminatory classifiers

ICIAR'10 Proceedings of the 7th international conference on Image Analysis and Recognition - Volume Part I
Analyzing facial behavioral features from videos

HBU'11 Proceedings of the Second international conference on Human Behavior Unterstanding
Feature extraction based on co-occurrence of adjacent local binary patterns

PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part II
Sparse temporal representations for facial expression recognition

PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part II
Extended local binary patterns for texture classification

Image and Vision Computing
Theories and applications of LBP: a survey

ICIC'11 Proceedings of the 7th international conference on Advanced Intelligent Computing Theories and Applications: with aspects of artificial intelligence
Discriminative features for texture description

Pattern Recognition
Letters: Learning spatiotemporal features by using independent component analysis with application to facial expression recognition

Neurocomputing
A novel distribution-based feature for rapid object detection

Neurocomputing
Scale-space texture description on SIFT-like textons

Computer Vision and Image Understanding
Directional line edge binary pattern for texture image indexing and retrieval

Proceedings of the International Conference on Advances in Computing, Communications and Informatics
Face recognition based on combination of human perception and local binary pattern

IScIDE'11 Proceedings of the Second Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
Local phase quantization for blur-insensitive image analysis

Image and Vision Computing
Local fuzzy pattern: a new way for micro-pattern analysis

IDEAL'12 Proceedings of the 13th international conference on Intelligent Data Engineering and Automated Learning
3D/4D facial expression analysis: An advanced annotated face model approach

Image and Vision Computing
Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis

Image and Vision Computing
Recognition of 3D facial expression dynamics

Image and Vision Computing
Real-time expression recognition from dynamic sequences of 3D facial scans

EG 3DOR'12 Proceedings of the 5th Eurographics conference on 3D Object Retrieval
Directional Binary Wavelet Patterns for Biomedical Image Indexing and Retrieval

Journal of Medical Systems
Towards a dynamic expression recognition system under facial occlusion

Pattern Recognition Letters
Depression analysis: a multimodal approach

Proceedings of the 14th ACM international conference on Multimodal interaction
A smile can reveal your age: enabling facial dynamics in age estimation

Proceedings of the 20th ACM international conference on Multimedia
Demographic classification from face videos using manifold learning

Neurocomputing
Facial expression recognition using tracked facial actions: Classifier performance analysis

Engineering Applications of Artificial Intelligence
Dynamic facial expression recognition using longitudinal facial expression atlases

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
Directional space-time oriented gradients for 3d visual pattern analysis

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
Motion interchange patterns for action recognition in unconstrained videos

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part VI
Exploring bag of words architectures in the facial expression domain

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume 2
Recognizing facial expressions using a novel shape motion descriptor

Proceedings of the Eighth Indian Conference on Computer Vision, Graphics and Image Processing
Spatiotemporal features for effective facial expression recognition

ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part I
A dynamic approach for detecting naturalistic affective states from facial videos during HCI

AI'12 Proceedings of the 25th Australasian joint conference on Advances in Artificial Intelligence
Recognizing expressions from face and body gesture by temporal normalized motion and appearance features

Image and Vision Computing
Image region description using orthogonal combination of local binary patterns enhanced with color information

Pattern Recognition
A novel LDA and HMM-Based technique for emotion recognition from facial expressions

MPRSS'12 Proceedings of the First international conference on Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction
Learning realistic facial expressions from web images

Pattern Recognition
Dynamic texture analysis and segmentation using deterministic partially self-avoiding walks

Expert Systems with Applications: An International Journal
3D face recognition using local binary patterns

Signal Processing
Texture classification based on BIMF monogenic signals

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
Dynamic texture synthesis in space with a spatio-temporal descriptor

ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume Part I
LBP - TOP based countermeasure against face spoofing attacks

ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume Part I
Face spoofing detection using dynamic texture

ACCV'12 Proceedings of the 11th international conference on Computer Vision - Volume Part I
Framework for reliable, real-time facial expression recognition for low resolution images

Pattern Recognition Letters
Discriminative histograms of local dominant orientation (D-HLDO) for biometric image feature extraction

Pattern Recognition
A review of motion analysis methods for human Nonverbal Communication Computing

Image and Vision Computing
Towards a comprehensive computational model foraesthetic assessment of videos

Proceedings of the 21st ACM international conference on Multimedia
Video classification and recommendation based on affective analysis of viewers

Neurocomputing
Satellite image mining for census collection: a comparative study with respect to the ethiopian hinterland

MLDM'13 Proceedings of the 9th international conference on Machine Learning and Data Mining in Pattern Recognition
Partial least squares regression on grassmannian manifold for emotion recognition

Proceedings of the 15th ACM on International conference on multimodal interaction
Emotion recognition in the wild challenge 2013

Proceedings of the 15th ACM on International conference on multimodal interaction
Emotion recognition with boosted tree classifiers

Proceedings of the 15th ACM on International conference on multimodal interaction
Multiple kernel learning for emotion recognition in the wild

Proceedings of the 15th ACM on International conference on multimodal interaction
Emotion recognition in the wild challenge (EmotiW) challenge and workshop summary

Proceedings of the 15th ACM on International conference on multimodal interaction
Learning finite Beta-Liouville mixture models via variational bayes for proportional data clustering

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
Modeling a stress signal

Applied Soft Computing
Facial expression recognition in dynamic sequences: An integrated approach

Pattern Recognition
Modeling observer stress for typical real environments

Expert Systems with Applications: An International Journal
Local descriptors and similarity measures for frontal face recognition: A comparative analysis

Journal of Visual Communication and Image Representation
Automatic facial expression recognition in real-time from dynamic sequences of 3D face scans

The Visual Computer: International Journal of Computer Graphics
Dynamic facial expression analysis based on extended spatio-temporal histogram of oriented gradients

International Journal of Biometrics
Rough set based pose invariant face recognition with mug shot images

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	0.15

Visualization

Abstract

Dynamic texture (DT) is an extension of texture to the temporal domain. Description and recognition of DTs have attracted growing attention. In this paper, a novel approach for recognizing DTs is proposed and its simplifications and extensions to facial image analysis are also considered. First, the textures are modeled with volume local binary patterns (VLBP), which are an extension of the LBP operator widely used in ordinary texture analysis, combining motion and appearance. To make the approach computationally simple and easy to extend, only the co-occurrences of the local binary patterns on three orthogonal planes (LBP-TOP) are then considered. A block-based method is also proposed to deal with specific dynamic events such as facial expressions in which local information and its spatial locations should also be taken into account. In experiments with two DT databases, DynTex and Massachusetts Institute of Technology (MIT), both the VLBP and LBP-TOP clearly outperformed the earlier approaches. The proposed block-based method was evaluated with the Cohn-Kanade facial expression database with excellent results. The advantages of our approach include local processing, robustness to monotonic gray-scale changes, and simple computation.