The effect of dynamics on identifying basic emotions from synthetic and natural faces

Authors:
Jari Kätsyri;Mikko Sams
Affiliations:
Laboratory of Computational Engineering, Helsinki University of Technology, P.O. Box 9203, FIN-02015 HUT, Finland;Laboratory of Computational Engineering, Helsinki University of Technology, P.O. Box 9203, FIN-02015 HUT, Finland
Venue:
International Journal of Human-Computer Studies
Year:
2008

Citing 7
Cited 2

A muscle model for animation three-dimensional facial expression

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
How Convincing is Mr. Data's Smile: Affective Expressions of Machines

User Modeling and User-Adapted Interaction
Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Communicating facial affect: it's not the realism, it's the motion

CHI '00 Extended Abstracts on Human Factors in Computing Systems
Comprehensive Database for Facial Expression Analysis

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
A Video Database of Moving Faces and People

IEEE Transactions on Pattern Analysis and Machine Intelligence
Subtle emotional expressions of synthetic characters

International Journal of Human-Computer Studies - Special issue: Subtle expressivity for characters and robots

Can local avatars satisfy a global audience? A case study of high-fidelity 3D facial avatar animation in subject identification and emotion perception by US and international groups

Computers in Entertainment (CIE) - SPECIAL ISSUE: Media Arts and Games (Part II)
Embodied Conversational Agent-Based Kiosk for Automated Interviewing

Journal of Management Information Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

The identification of basic emotions (anger, disgust, fear, happiness, sadness and surprise) has been studied widely from pictures of facial expressions. Until recently, the role of dynamic information in identifying facial emotions has received little attention. There is evidence that dynamics improves the identification of basic emotions from synthetic (computer-animated) facial expressions [Wehrle, T., Kaiser, S., Schmidt, S., Scherer, K.R., 2000. Studying dynamic models of facial expression of emotion using synthetic animated faces. Journal of Personality and Social Psychology 78 (1), 105-119.]; however, similar result has not been confirmed with natural human faces. We compared the identification of basic emotions from both natural and synthetic dynamic vs. static facial expressions in 54 subjects. We found no significant differences in the identification of static and dynamic expressions from natural faces. In contrast, some synthetic dynamic expressions were identified much more accurately than static ones. This effect was evident only with synthetic facial expressions whose static displays were non-distinctive. Our results show that dynamics does not improve the identification of already distinctive static facial displays. On the other hand, dynamics has an important role for identifying subtle emotional expressions, particularly from computer-animated synthetic characters.