A dynamic approach for detecting naturalistic affective states from facial videos during HCI

Authors:
Hamed Monkaresi;M. S. Hussain;Rafael A. Calvo
Affiliations:
School of Electrical and Information Engineering, University of Sydney, Australia;School of Electrical and Information Engineering, University of Sydney, Australia;School of Electrical and Information Engineering, University of Sydney, Australia
Venue:
AI'12 Proceedings of the 25th Australasian joint conference on Advances in Artificial Intelligence
Year:
2012

Citing 23
Cited 0

Affective computing

Affective computing
Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Affective computing: challenges

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Evaluation of Gabor-Wavelet-Based Facial Action Unit Recognition in Image Sequences of Increasing Complexity

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Facial expression recognition from video sequences: temporal and static modeling

Computer Vision and Image Understanding - Special issue on Face recognition
Real time facial expression recognition in video using support vector machines

Proceedings of the 5th international conference on Multimodal interfaces
Combining Pattern Classifiers: Methods and Algorithms

Combining Pattern Classifiers: Methods and Algorithms
Fully Automatic Facial Action Recognition in Spontaneous Behavior

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
ENCARA2: Real-time detection of multiple faces at different resolutions in video streams

Journal of Visual Communication and Image Representation
Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions

IEEE Transactions on Pattern Analysis and Machine Intelligence
When Human Coders (and Machines) Disagree on the Meaning of Facial Affect in Spontaneous Videos

IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Dynamics of facial expression extracted automatically from video

Image and Vision Computing
Combined support vector machines and hidden Markov models for modeling facial action temporal dynamics

HCI'07 Proceedings of the 2007 IEEE international conference on Human-computer interaction
Multimodal semi-automated affect detection from conversational cues, gross body language, and facial features

User Modeling and User-Adapted Interaction
A Dynamic Texture-Based Approach to Recognition of Facial Actions and Their Temporal Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Affect Detection: An Interdisciplinary Review of Models, Methods, and Their Applications

IEEE Transactions on Affective Computing
Siento: an experimental platform for behavior and psychophysiology in HCI

ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part II
Facial action recognition for facial expression analysis from static face images

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Learning from examples in the small sample case: face expression recognition

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
A real-time automated system for the recognition of human facial expressions

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Automatic natural expression recognition using head movement and skin color features

Proceedings of the International Working Conference on Advanced Visual Interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

Significant progress has been made in automatic facial expression analysis using facial images and videos. The recognition reliability of most current approaches is still poor in naturalistic expressions compared to acted ones. Most of these methods use a static image of each expression that captures the characteristic image at the apex. However, according to psychologists, analyzing a sequence of images in a dynamic manner produces more accurate and robust recognition of facial affect expressions. In this paper, a new dynamic model is proposed for detecting naturalistic affect expressions. The Local Binary Pattern in Three Orthogonal Planes (LBP-TOP) is considered for modeling appearance and motion of facial features. The International Affective Picture System (IAPS) collection was used as stimulus for triggering naturalistic affective states. The dynamic approach produced an improvement of 16% for valence classification and 22% for arousal classification over previous studies.