Fast-FACS: a computer-assisted system to increase speed and reliability of manual FACS coding

Authors:
Fernando De la Torre;Tomas Simon;Zara Ambadar;Jeffrey F. Cohn
Affiliations:
Robotics Institute, Carnegie Mellon University, Pittsburgh, PA;Robotics Institute, Carnegie Mellon University, Pittsburgh, PA;University of Pittsburgh, Pittsburgh, PA;Robotics Institute, Carnegie Mellon University, Pittsburgh, PA and University of Pittsburgh, Pittsburgh, PA
Venue:
ACII'11 Proceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I
Year:
2011

Citing 6
Cited 0

Active Appearance Models

ECCV '98 Proceedings of the 5th European Conference on Computer Vision-Volume II - Volume II
Active Appearance Models Revisited

International Journal of Computer Vision
Fully Automatic Facial Action Recognition in Spontaneous Behavior

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
Active Image Labeling and Its Application to Facial Action Labeling

ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part II
Combined support vector machines and hidden Markov models for modeling facial action temporal dynamics

HCI'07 Proceedings of the 2007 IEEE international conference on Human-computer interaction
Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Quantified Score

Hi-index	0.00

Visualization

Abstract

FACS (Facial Action Coding System) coding is the state of the art in manual measurement of facial actions. FACS coding, however, is labor intensive and difficult to standardize. A goal of automated FACS coding is to eliminate the need for manual coding and realize automatic recognition and analysis of facial actions. Success of this effort depends in part on access to reliably coded corpora; however, manual FACS coding remains expensive and slow. This paper proposes Fast-FACS, a computer vision aided system that improves speed and reliability of FACS coding. Three are the main novelties of the system: (1) to the best of our knowledge, this is the first paper to predict onsets and offsets from peaks, (2) use Active Appearance Models for computer assisted FACS coding, (3) learn an optimal metric to predict onsets and offsets from peaks. The system was tested in the RU-FACS database, which consists of natural facial behavior during a twoperson interview. Fast-FACS reduced manual coding time by nearly 50% and demonstrated strong concurrent validity with manual FACS coding.