Automatic Analysis of Facial Expressions: The State of the Art

Authors:
Maja Pantic;Leon J. M. Rothkrantz
Affiliations:
Delft Univ. of Technology, Delft, The Netherlands;Delft Univ. of Technology, Delft, The Netherlands
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2000

Citing 41
Cited 252

EMPATH: face, emotion, and gender recognition using holons

NIPS-3 Proceedings of the 1990 conference on Advances in neural information processing systems 3
Description and synthesis of facial expression based on isodensity maps

CG International '92 Proceedings of the 10th International Conference of the Computer Graphics Society on Visual computing : integrating computer graphics with computer vision: integrating computer graphics with computer vision
A fast algorithm for active contours and curvature estimation

CVGIP: Image Understanding
Automatic recognition and analysis of human faces and facial expressions: a survey

Pattern Recognition
Distributed representation and analysis of visual motion

Distributed representation and analysis of visual motion
Communicative facial displays as a new conversational modality

CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
Active shape models—their training and application

Computer Vision and Image Understanding
Coding, Analysis, Interpretation, and Recognition of Facial Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Neural Network-Based Face Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Example-Based Learning for View-Based Human Face Detection

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion

International Journal of Computer Vision
An anthropometric face model using variational techniques

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
An Analytic-to-Holistic Approach for Face Recognition Based on a Single Frontal View

IEEE Transactions on Pattern Analysis and Machine Intelligence
Parametric Hidden Markov Models for Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
An HMM-Based Threshold Model Approach for Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Classifying Facial Actions

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic Classification of Single Facial Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Numerical Recipes in C: The Art of Scientific Computing

Numerical Recipes in C: The Art of Scientific Computing
Analyzing Facial Expressions for Virtual Conferencing

IEEE Computer Graphics and Applications
3-D Motion Estimation in Model-Based Facial Image Coding

IEEE Transactions on Pattern Analysis and Machine Intelligence
Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Face Recognition Using Active Appearance Models

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
Active Appearance Models

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
3-D Emotion Space for Interactive Communication

ICSC '95 Proceedings of the Third International Computer Science Conference on Image Analysis Applications and Computer Graphics
Facial Expression Recognition and Its Degree Estimation

CVPR '97 Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR '97)
Face and Facial Feature Extraction from Color Image

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Feature-Point Tracking by Optical Flow Discriminates Subtle Differences in Facial Expression

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Online Facial Expression Recognition Based on Personalized Galleries

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Expression Recognition from Time-Sequential Facial Images by Use of Expression Change Model

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Automated Facial Expression Recognition Based on FACS Action Units

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Multimodal Human Emotion/Expression Recognition

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
PersonSpotter - Fast and Robust System for Human Detection, Tracking and Recognition

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Automatic Detection of Human Faces in Natural Scene Images by Use of a Skin Color Model and of Invariant Moments

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Spotting Segments Displaying Facial Expression from Image Sequences Using HMM

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Comparison Between Geometry-Based and Gabor-Wavelets-Based Facial Expression Recognition Using Multi-Layer Perceptron

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Coding Facial Expressions with Gabor Wavelets

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
A real-time face tracker

WACV '96 Proceedings of the 3rd IEEE Workshop on Applications of Computer Vision (WACV '96)
Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion

ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Facial Expressions Recognition Using Discrete Hopfield Neural Network

ICIP '97 Proceedings of the 1997 International Conference on Image Processing (ICIP '97) 3-Volume Set-Volume 1 - Volume 1
An Expert System for Multiple Emotional Classification of Facial Expressions

ICTAI '99 Proceedings of the 11th IEEE International Conference on Tools with Artificial Intelligence

Face Detection in Color Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recognizing Imprecisely Localized, Partially Occluded, and Expression Variant Faces from a Single Sample per Class

IEEE Transactions on Pattern Analysis and Machine Intelligence
Online face analysis: coupling head pose-tracking with face expression analysis

Proceedings of the tenth ACM international conference on Multimedia
Pseudo-entropy Similarity for Human Biometrics

ECCV '02 Proceedings of the International ECCV 2002 Workshop Copenhagen on Biometric Authentication
Special issue on face recognition

Computer Vision and Image Understanding - Special issue on Face recognition
Facial expression recognition from video sequences: temporal and static modeling

Computer Vision and Image Understanding - Special issue on Face recognition
Face recognition: A literature survey

ACM Computing Surveys (CSUR)
Real time facial expression recognition in video using support vector machines

Proceedings of the 5th international conference on Multimodal interfaces
Mouthbrush: drawing and painting by hand and mouth

Proceedings of the 5th international conference on Multimodal interfaces
The components of conversational facial expressions

APGV '04 Proceedings of the 1st Symposium on Applied perception in graphics and visualization
Latent semantic analysis of facial action codes for automatic facial expression recognition

Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval
Semisupervised Learning of Classifiers: Theory, Algorithms, and Their Application to Human-Computer Interaction

IEEE Transactions on Pattern Analysis and Machine Intelligence
Active and Dynamic Information Fusion for Facial Expression Understanding from Image Sequences

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Video Database of Moving Faces and People

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning

IEEE Transactions on Pattern Analysis and Machine Intelligence
Manipulating Video Sequences to Determine the Components of Conversational Facial Expressions

ACM Transactions on Applied Perception (TAP)
Face and body gesture recognition for a vision-based multimodal analyzer

VIP '05 Proceedings of the Pan-Sydney area workshop on Visual information processing
Designing, playing, and performing with a vision-based mouth interface

NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
Task oriented facial behavior recognition with selective sensing

Computer Vision and Image Understanding
Meticulously Detailed Eye Region Model and Its Application to Analysis of Facial Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Some advances and challenges in live biometrics, personnel management, and other "Human being" applications

Enhanced methods in computer security, biometric and artificial intelligence systems
How effective are landmarks and their geometry for face recognition?

Computer Vision and Image Understanding
Evolutionary feature synthesis for facial expression recognition

Pattern Recognition Letters - Special issue: Evolutionary computer vision and image understanding
Automated Facial Expression Classification and affect interpretation using infrared measurement of facial skin temperature variations

ACM Transactions on Autonomous and Adaptive Systems (TAAS)
Recognizing facial expressions using active textures with wrinkles

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
Toward multimodal fusion of affective cues

Proceedings of the 1st ACM international workshop on Human-centered multimedia
Modeling naturalistic affective states via facial and vocal expressions recognition

Proceedings of the 8th international conference on Multimodal interfaces
Foundations of human computing: facial expression and emotion

Proceedings of the 8th international conference on Multimodal interfaces
Detecting social interactions of the elderly in a nursing home environment

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Face recognition from a single image per person: A survey

Pattern Recognition
Semantic-based facial expression recognition using analytical hierarchy process

Expert Systems with Applications: An International Journal
Berlin Brain-Computer Interface-The HCI communication channel for discovery

International Journal of Human-Computer Studies
Physiological and subjective responses to articulated robot motion

Robotica
Pre-collision safety strategies for human-robot interaction

Autonomous Robots
The Berlin Brain-Computer Interface (BBCI) --- towards a new communication channel for online control in gaming applications

Multimedia Tools and Applications
Facial expression recognition for multiplayer online games

Proceedings of the 3rd Australasian conference on Interactive entertainment
Visual learning of texture descriptors for facial expression recognition in thermal imagery

Computer Vision and Image Understanding
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
A dependence maximization view of clustering

Proceedings of the 24th international conference on Machine learning
Distributing expressional faces in 2-D emotional space

Proceedings of the 6th ACM international conference on Image and video retrieval
Authentic facial expression analysis

Image and Vision Computing
Static topographic modeling for facial expression recognition and analysis

Computer Vision and Image Understanding
Multimodal human-computer interaction: A survey

Computer Vision and Image Understanding
Biometric technologies and applications

AIAP'07 Proceedings of the 25th conference on Proceedings of the 25th IASTED International Multi-Conference: artificial intelligence and applications
Hybrid-boost learning for multi-pose face detection and facial expression recognition

Pattern Recognition
Texture and shape information fusion for facial expression and facial action unit recognition

Pattern Recognition
Facial expression classification: An approach based on the fusion of facial deformations using the transferable belief model

International Journal of Approximate Reasoning
Eliciting, capturing and tagging spontaneous facialaffect in autism spectrum disorder

Proceedings of the 9th international conference on Multimodal interfaces
A survey of affect recognition methods: audio, visual and spontaneous expressions

Proceedings of the 9th international conference on Multimodal interfaces
Detecting communication errors from visual cues during the system's conversational turn

Proceedings of the 9th international conference on Multimodal interfaces
Cloud basis function neural network: A modified RBF network architecture for holistic facial expression recognition

Pattern Recognition
Automatic emotional stimulus identification from facial expressions

SPPR'07 Proceedings of the Fourth conference on IASTED International Conference: Signal Processing, Pattern Recognition, and Applications
Simultaneous Facial Action Tracking and Expression Recognition in the Presence of Head Motion

International Journal of Computer Vision
Cognitive modeling in software and relation to human emotional reasoning

ACS'07 Proceedings of the 7th Conference on 7th WSEAS International Conference on Applied Computer Science - Volume 7
A simple approach to facial expression recognition

CEA'07 Proceedings of the 2007 annual Conference on International Conference on Computer Engineering and Applications
Facial expression recognition and synthesis toward construction of quasi-personality

AIKED'07 Proceedings of the 6th Conference on 6th WSEAS Int. Conf. on Artificial Intelligence, Knowledge Engineering and Data Bases - Volume 6
Towards understanding expression for tele-operation

International Journal of Computer Applications in Technology
Dealing with feature uncertainty in facial expression recognition

International Journal of Intelligent Systems Technologies and Applications
An analysis of facial expression recognition under partial facial image occlusion

Image and Vision Computing
A multi-agent based system for affective peer-e-learning

MobiMedia '06 Proceedings of the 2nd international conference on Mobile multimedia communications
An experimental comparison of gender classification methods

Pattern Recognition Letters
Facial expression recognition as a creative interface

Proceedings of the 13th international conference on Intelligent user interfaces
Affective interaction based on person-independent facial expression space

Neurocomputing
Extension of cascaded simple feature based face detection to facial expression recognition

Pattern Recognition Letters
A real-time facial expression recognition system for online games

International Journal of Computer Games Technology - Joint International Conference on Cyber Games and Interactive Entertainment 2006
Bimodal person-dependent emotion recognition comparison of feature level and decision level information fusion

Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments
Real-Time Facial Expression Recognition for Natural Interaction

IbPRIA '07 Proceedings of the 3rd Iberian conference on Pattern Recognition and Image Analysis, Part II
Research on Affective State Recognition in E-Learning System by Using Neural Network

ICCS '07 Proceedings of the 7th international conference on Computational Science, Part III: ICCS 2007
Facial Expression Analysis on Semantic Neighborhood Preserving Embedding

ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Part II--Advances in Neural Networks
Towards Knowledge-Based Affective Interaction: Situational Interpretation of Affect

ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech

Affect and Emotion in Human-Computer Interaction
Effective Emotional Classification Combining Facial Classifiers and User Assessment

AMDO '08 Proceedings of the 5th international conference on Articulated Motion and Deformable Objects
Fuzzy case-based reasoning for facial expression recognition

Fuzzy Sets and Systems
Boosting encoded dynamic features for facial expression recognition

Pattern Recognition Letters
Face detection and recognition of natural human emotion using Markov random fields

Personal and Ubiquitous Computing
Similarity Features for Facial Event Analysis

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Automatic real time localization of frowning and smiling faces under controlled head rotations

WSEAS Transactions on Signal Processing
Smile Detection for User Interfaces

ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing, Part II
Integrating a mixed-feature model and multiclass support vector machine for facial expression recognition

Integrated Computer-Aided Engineering
Facial expression recognition based on shape and texture

Pattern Recognition
Emotion recognition using brain activity

CompSysTech '08 Proceedings of the 9th International Conference on Computer Systems and Technologies and Workshop for PhD Students in Computing
Facial emotion and gesture reproduction method for substitute robot of remote person

Computers and Industrial Engineering
Combining Features for Recognizing Emotional Facial Expressions in Static Images

Verbal and Nonverbal Features of Human-Human and Human-Machine Interaction
Intelligent human interface based on mental cloning-based software

Knowledge-Based Systems
Facial Expression Recognition by Supervised Independent Component Analysis Using MAP Estimation

IEICE - Transactions on Information and Systems
Facial expression recognition based on Local Binary Patterns: A comprehensive study

Image and Vision Computing
Pose-Invariant Facial Expression Recognition Using Variable-Intensity Templates

International Journal of Computer Vision
Recognizing Facial Expressions Using Model-Based Image Interpretation

Multimodal Signals: Cognitive and Algorithmic Issues
Haptic conviction widgets

Proceedings of Graphics Interface 2009
Cognitive Modeling in Software and Relation to Human Emotional Reasoning

Proceedings of the 2007 conference on New Trends in Software Methodologies, Tools and Techniques: Proceedings of the sixth SoMeT_07
A bi-modal face recognition framework integrating facial expression with facial appearance

Pattern Recognition Letters
Boosted multi-resolution spatiotemporal descriptors for facial expression recognition

Pattern Recognition Letters
A novel approach to classification of facial expressions from 3D-mesh datasets using modified PCA

Pattern Recognition Letters
Automated facial expression recognition – an integrated approach with optical flow analysis and Support Vector Machines

International Journal of Intelligent Systems Technologies and Applications
Did I Get It Right: Head Gestures Analysis for Human-Machine Interactions

Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
An agreement measure for determining inter-annotator reliability of human judgements on affective text

HumanJudge '08 Proceedings of the Workshop on Human Judgements in Computational Linguistics
Social signal processing: Survey of an emerging domain

Image and Vision Computing
Automatic facial expression recognition on a single 3D face by exploring shape deformation

MM '09 Proceedings of the 17th ACM international conference on Multimedia
Perceptually guided expressive facial animation

Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Facial emotion classification using active appearance model and support vector machine classifier

Machine Graphics & Vision International Journal
Bilinear Models for Spatio-Temporal Point Distribution Analysis

International Journal of Computer Vision
Task oriented facial behavior recognition with selective sensing

Computer Vision and Image Understanding
How effective are landmarks and their geometry for face recognition?

Computer Vision and Image Understanding
Novel multiclass classifiers based on the minimization of the within-class variance

IEEE Transactions on Neural Networks
Overview of automatic facial expressions analysis

VIIP '07 The Seventh IASTED International Conference on Visualization, Imaging and Image Processing
Facial Expression Invariants for Estimating Mental States of Person

Proceedings of the 2009 conference on New Trends in Software Methodologies, Tools and Techniques: Proceedings of the Eighth SoMeT_09
Salient feature and reliable classifier selection for facial expression classification

Pattern Recognition
Emotion recognition with consideration of facial expression and physiological signals

CIBCB'09 Proceedings of the 6th Annual IEEE conference on Computational Intelligence in Bioinformatics and Computational Biology
Affective computation on EEG correlates of emotion from musical and vocal stimuli

IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
Manifold based analysis of facial expression

Image and Vision Computing
Dynamics of facial expression extracted automatically from video

Image and Vision Computing
Automatic emotional stimulus identification from facial expressions

SPPRA '07 Proceedings of the Fourth IASTED International Conference on Signal Processing, Pattern Recognition, and Applications
Facial expression spatial charts for representing of dynamic diversity of facial expressions

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Facial-component-based bag of words and PHOG descriptor for facial expression recognition

SMC'09 Proceedings of the 2009 IEEE international conference on Systems, Man and Cybernetics
Multimodal interfaces: Challenges and perspectives

Journal of Ambient Intelligence and Smart Environments
Real-time 2D+3D facial action and expression recognition

Pattern Recognition
Inexact graph matching for model-based recognition: Evaluation and comparison of optimization algorithms

Pattern Recognition
Adjusted pixel features for robust facial component classification

Image and Vision Computing
Evaluation of expression recognition techniques

CIVR'03 Proceedings of the 2nd international conference on Image and video retrieval
Facial recognition in video

AVBPA'03 Proceedings of the 4th international conference on Audio- and video-based biometric person authentication
Unobtrusive multimodal emotion detection in adaptive interfaces: speech and facial expressions

FAC'07 Proceedings of the 3rd international conference on Foundations of augmented cognition
Facial expression recognition based on color lines model and region based processing

UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction
On assisting a visual-facial affect recognition system with keyboard-stroke pattern information

Knowledge-Based Systems
Face to face communications in multiplayer online games: a real-time system

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: applications and services
HCI and the face: towards an art of the soluble

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability
Analyzing facial expression by fusing manifolds

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part II
Person-similarity weighted feature for expression recognition

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part II
A binary decision tree based real-time emotion detection system

ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part I
Feature-adaptive motion energy analysis for facial expression recognition

ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part I
Comparing a transferable belief model capable of recognizing facial expressions with the latest human data

ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part I
Neural network classification of photogenic facial expressions based on fiducial points and Gabor features

PSIVT'07 Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology
Facial expression recognition for human-robot interaction: a prototype

RobVis'08 Proceedings of the 2nd international conference on Robot vision
Real-time capable method for facial expression recognition in color and stereo vision

ICCSA'07 Proceedings of the 2007 international conference on Computational science and its applications - Volume Part I
Affective negotiation support systems

Journal of Ambient Intelligence and Smart Environments
The SEMAINE API: towards a standards-based framework for building emotion-oriented systems

Advances in Human-Computer Interaction - Special issue on emotion-aware natural interaction
Facial expression recognition using two-class discriminant features

BioID_MultiComm'09 Proceedings of the 2009 joint COST 2101 and 2102 international conference on Biometric ID management and multimodal communication
Combining audio and video for detection of spontaneous emotions

BioID_MultiComm'09 Proceedings of the 2009 joint COST 2101 and 2102 international conference on Biometric ID management and multimodal communication
A model-based facial expression recognition algorithm using principal components analysis

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Multimodal information fusion application to human emotion recognition from face and speech

Multimedia Tools and Applications
Facial affect recognition using regularized discriminant analysis-based algorithms

EURASIP Journal on Advances in Signal Processing - Special issue on video analysis for human behavior understanding
Automatic edge-based localization of facial features from images with complex facial expressions

Pattern Recognition Letters
Facial expression recognition on multiple manifolds

Pattern Recognition
Face recognition in global harmonic subspace

IEEE Transactions on Information Forensics and Security
Eyes do not lie: spontaneous versus posed smiles

Proceedings of the international conference on Multimedia
Sonify your face: facial expressions for sound generation

Proceedings of the international conference on Multimedia
Visual affect recognition

Visual affect recognition
Emotion recognition from arbitrary view facial images

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Curvelet entropy for facial expression recognition

PCM'10 Proceedings of the Advances in multimedia information processing, and 11th Pacific Rim conference on Multimedia: Part II
Foundations of human computing: facial expression and emotion

ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Modeling naturalistic affective states via facial, vocal, and bodily expressions recognition

ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Emotion and reinforcement: affective facial expressions facilitate robot learning

ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Modelling the communication atmosphere: a human centered multimedia approach to evaluate communicative situations

ICMI'06/IJCAI'07 Proceedings of the ICMI 2006 and IJCAI 2007 international conference on Artifical intelligence for human computing
Facial event classification with task oriented dynamic Bayesian network

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Facial expression classification based on local spatiotemporal edge and texture descriptors

Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research
Dynamic soft encoded patterns for facial event analysis

Computer Vision and Image Understanding
A multimodal human-robot-dialog applying emotional feedbacks

ICSR'10 Proceedings of the Second international conference on Social robotics
An automated face reader for fatigue detection

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Facial expression recognition using fisher weight maps

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Authentic facial expression analysis

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Orthogonal Tensor Neighborhood Preserving Embedding for facial expression recognition

Pattern Recognition
Differential optical flow applied to automatic facial expression recognition

Neurocomputing
Shape analysis of local facial patches for 3D facial expression recognition

Pattern Recognition
Simultaneous feature selection and classifier training via linear programming: a case study for face expression recognition

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Learning bayesian network classifiers for facial expression recognition using both labeled and unlabeled data

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
Recognizing continuous grammatical marker facial gestures in sign language video

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
Use of nonverbal communication in dialog system

ICOSSSE'05 Proceedings of the 4th WSEAS/IASME international conference on System science and simulation in engineering
Feature level analysis for 3D facial expression recognition

Neurocomputing
An efficient facial expression detection system

Machine Graphics & Vision International Journal
Theories, methods and current research on emotions in library and information science, information retrieval and human-computer interaction

Information Processing and Management: an International Journal
Turk-2, a multi-modal chess player

International Journal of Human-Computer Studies
Candid portrait selection from video

Proceedings of the 2011 SIGGRAPH Asia Conference
Individual feature-appearance for facial action recognition

ICIAR'11 Proceedings of the 8th international conference on Image analysis and recognition - Volume Part II
Facial expression recognition from near-infrared videos

Image and Vision Computing
Automatic facial expression recognition using statistical-like moments

ICIAP'11 Proceedings of the 16th international conference on Image analysis and processing: Part I
Efficient detection of consecutive facial expression apices using biologically based log-normal filters

ISVC'11 Proceedings of the 7th international conference on Advances in visual computing - Volume Part I
Adaptively weighted subpattern-based isometric projection for face recognition

AICI'11 Proceedings of the Third international conference on Artificial intelligence and computational intelligence - Volume Part III
Multi-score learning for affect recognition: the case of body postures

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
Active class selection for arousal classification

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Inductive transfer learning for handling individual differences in affective computing

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
A psychologically-inspired match-score fusion mode for video-based facial expression recognition

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Continuous emotion recognition using gabor energy filters

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Naturalistic affective expression classification by a multi-stage approach based on hidden Markov models

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Fully automatic 3D facial expression recognition using a region-based approach

J-HGBU '11 Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding
GA-driven LDA in KPCA space for facial expression recognition

ICNC'05 Proceedings of the First international conference on Advances in Natural Computation - Volume Part II
Automatic facial expression recognition with AAM-Based feature extraction and SVM classifier

MICAI'06 Proceedings of the 5th Mexican international conference on Artificial Intelligence
Facial expression modelling from still images using a single generic 3d head model

DAGM'06 Proceedings of the 28th conference on Pattern Recognition
Face description for perceptual user interfaces

CAEPIA'05 Proceedings of the 11th Spanish association conference on Current Topics in Artificial Intelligence
Analysis of landmarks in recognition of face expressions

Pattern Recognition and Image Analysis
Real-time implementation of face detection for a ubiquitous computing

ICCSA'05 Proceedings of the 2005 international conference on Computational Science and its Applications - Volume Part I
Emotional facial expression classification for multimodal user interfaces

AMDO'06 Proceedings of the 4th international conference on Articulated Motion and Deformable Objects
A canonical face based virtual face modeling

ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
A novel real time system for facial expression recognition

ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
Generalization of a vision-based computational model of mind-reading

ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
A facial expression classification algorithm based on principle component analysis

ISNN'06 Proceedings of the Third international conference on Advnaces in Neural Networks - Volume Part II
Pain monitoring: A dynamic and context-sensitive system

Pattern Recognition
Neural network cascade for facial feature localization

ANNPR'10 Proceedings of the 4th IAPR TC3 conference on Artificial Neural Networks in Pattern Recognition
Analysis, interpretation, and recognition of facial action units and expressions using neuro-fuzzy modeling

ANNPR'10 Proceedings of the 4th IAPR TC3 conference on Artificial Neural Networks in Pattern Recognition
A model based method for automatic facial expression recognition

ECML'05 Proceedings of the 16th European conference on Machine Learning
Multimodal human computer interaction: a survey

ICCV'05 Proceedings of the 2005 international conference on Computer Vision in Human-Computer Interaction
Appearance manifold of facial expression

ICCV'05 Proceedings of the 2005 international conference on Computer Vision in Human-Computer Interaction
Fuzzy-C-Mean determines the principle component pairs to estimate the degree of emotion from facial expressions

FSKD'05 Proceedings of the Second international conference on Fuzzy Systems and Knowledge Discovery - Volume Part I
Analysis of facial configuration from realistic 3d face reconstruction of young korean men

AsiaSim'04 Proceedings of the Third Asian simulation conference on Systems Modeling and Simulation: theory and applications
Real time facial expression recognition using local binary patterns and linear programming

MICAI'05 Proceedings of the 4th Mexican international conference on Advances in Artificial Intelligence
Human face analysis: from identity to emotion and intention recognition

ICEB'10 Proceedings of the Third international conference on Ethics and Policy of Biometrics and International Data Sharing
Face for ambient interface

Ambient Intelligence in Everyday Life
EigenExpress approach in recognition of facial expression using GPU

ECCV'06 Proceedings of the 2006 international conference on Computer Vision in Human-Computer Interaction
Audio-Visual processing in meetings: seven questions and current AMI answers

MLMI'06 Proceedings of the Third international conference on Machine Learning for Multimodal Interaction
Facial expressions recognition in a single static as well as dynamic facial images using tracking and probabilistic neural networks

PSIVT'06 Proceedings of the First Pacific Rim conference on Advances in Image and Video Technology
Attentiveness detection using continuous restricted boltzmann machine in e-learning environment

ICHL'09 Proceedings of the Second international conference on Hybrid Learning and Education
Recognizing combinations of facial action units with different intensity using a mixture of hidden markov models and neural network

MCS'10 Proceedings of the 9th international conference on Multiple Classifier Systems
Recognition of facial gestures based on support vector machines

IbPRIA'05 Proceedings of the Second Iberian conference on Pattern Recognition and Image Analysis - Volume Part I
A realistic dynamic facial expression transfer method

Neurocomputing
Spontaneous pain expression recognition in video sequences

VoCS'08 Proceedings of the 2008 international conference on Visions of Computer Science: BCS International Academic Conference
Automatic facial expression recognition based on spatiotemporal descriptors

Pattern Recognition Letters
Spontaneous facial expression recognition: automatic aggression detection

HAIS'12 Proceedings of the 7th international conference on Hybrid Artificial Intelligent Systems - Volume Part I
2011 Special Issue: Improving subspace learning for facial expression recognition using person dependent and geometrically enriched training sets

Neural Networks
Comparative evaluation of 3D vs. 2D modality for automatic detection of facial action units

Pattern Recognition
UX_Mate: from facial expressions to UX evaluation

Proceedings of the Designing Interactive Systems Conference
Facial expression recognition for detecting human aggression

ICAISC'12 Proceedings of the 11th international conference on Artificial Intelligence and Soft Computing - Volume Part I
On the simultaneous recognition of identity and expression from BU-3DFE datasets

Pattern Recognition Letters
Multimodal interfaces: Challenges and perspectives

Journal of Ambient Intelligence and Smart Environments
Computer recognition of facial expressions of emotion

MLDM'12 Proceedings of the 8th international conference on Machine Learning and Data Mining in Pattern Recognition
Exploring the effect of illumination on automatic expression recognition using the ICT-3DRFE database

Image and Vision Computing
3D/4D facial expression analysis: An advanced annotated face model approach

Image and Vision Computing
Reshaping 3D facial scans for facial appearance modeling and 3D facial expression analysis

Image and Vision Computing
LUI: lip in multimodal mobile GUI interaction

Proceedings of the 14th ACM international conference on Multimodal interaction
Automatic facial pose determination of 3D range data for face model and expression identification

ICB'07 Proceedings of the 2007 international conference on Advances in Biometrics
Facial expression recognition using 3D facial feature distances

ICIAR'07 Proceedings of the 4th international conference on Image Analysis and Recognition
Generalized Gaussian mixture models as a nonparametric Bayesian approach for clustering using class-specific visual features

Journal of Visual Communication and Image Representation
Dynamic facial expression recognition using longitudinal facial expression atlases

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part II
A fast and robust feature set for cross individual facial expression recognition

ICCVG'12 Proceedings of the 2012 international conference on Computer Vision and Graphics
Automatic Facial Expression Recognition by Facial Parts Location with Boosted-LBP

International Journal of Computer Vision and Image Processing
Fusion of facial expressions and EEG for implicit affective tagging

Image and Vision Computing
Recognizing expressions from face and body gesture by temporal normalized motion and appearance features

Image and Vision Computing
Towards the automatic detection of spontaneous agreement and disagreement based on nonverbal behaviour: A survey of related cues, databases, and tools

Image and Vision Computing
A unified probabilistic framework for automatic 3D facial expression analysis based on a Bayesian belief inference and statistical feature models

Image and Vision Computing
Enhancing the believability of embodied conversational agents through environment-, self- and interaction-awareness

ACSC '11 Proceedings of the Thirty-Fourth Australasian Computer Science Conference - Volume 113
Measuring the degree of face familiarity based on extended NMF

ACM Transactions on Applied Perception (TAP)
Enhancing expression recognition in the wild with unlabeled reference data

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part II
A review of motion analysis methods for human Nonverbal Communication Computing

Image and Vision Computing
Robust facial expressions recognition using 3D average face and ameliorated adaboost

Proceedings of the 21st ACM international conference on Multimedia
Face model fitting with learned displacement experts and multi-band images

Pattern Recognition and Image Analysis
Depression recognition based on dynamic facial and vocal expression features using partial least square regression

Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge
A facial expression recognition method by fusing multiple sparse representation based classifiers

ISNN'13 Proceedings of the 10th international conference on Advances in Neural Networks - Volume Part I
Partial least squares regression on grassmannian manifold for emotion recognition

Proceedings of the 15th ACM on International conference on multimodal interaction
Why is facial expression analysis in the wild challenging?

Proceedings of the 2013 on Emotion recognition in the wild challenge and workshop
GPSO versus GA in facial emotion detection

International Journal of Artificial Intelligence and Soft Computing
On approaching 2D-FPCA technique to improve image representation in frequency domain

Proceedings of the Fourth Symposium on Information and Communication Technology
Affective and cognitive design for mass personalization: status and prospect

Journal of Intelligent Manufacturing
Facial expression recognition in dynamic sequences: An integrated approach

Pattern Recognition
Spontaneous facial expression recognition: A robust metric learning approach

Pattern Recognition
Features classification using geometrical deformation feature vector of support vector machine and active appearance algorithm for automatic facial expression recognition

Machine Vision and Applications

Quantified Score

Hi-index	0.15

Visualization

Abstract

Humans detect and interpret faces and facial expressions in a scene with little or no effort. Still, development of an automated system that accomplishes this task is rather difficult. There are several related problems: detection of an image segment as a face, extraction of the facial expression information, and classification of the expression (e.g., in emotion categories). A system that performs these operations accurately and in real time would form a big step in achieving a human-like interaction between man and machine. This paper surveys the past work in solving these problems. The capability of the human visual system with respect to these problems is discussed, too. It is meant to serve as an ultimate goal and a guide for determining recommendations for development of an automatic facial expression analyzer.