Extracting emotion from speech: towards emotional speech-driven facial animations

Authors:
Olusola Olumide Aina;Knut Hartmann;Thomas Strothotte
Affiliations:
Department of Simulation and Graphics, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany;Department of Simulation and Graphics, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany;Department of Simulation and Graphics, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany
Venue:
SG'03 Proceedings of the 3rd international conference on Smart graphics
Year:
2003

Citing 7
Cited 0

Affective computing

Affective computing
Data mining: practical machine learning tools and techniques with Java implementations

Data mining: practical machine learning tools and techniques with Java implementations
Speech-driven cartoon animation with emotions

MULTIMEDIA '01 Proceedings of the ninth ACM international conference on Multimedia
Recognition of Affective Communicative Intent in Robot-Directed Speech

Autonomous Robots
Automatic Spoken Affect Classification and Analysis

FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
The production and recognition of emotions in speech: features and algorithms

International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Emotion Recognition and Its Application to Computer Agents with Spontaneous Interactive Capabilities

ICMCS '99 Proceedings of the 1999 IEEE International Conference on Multimedia Computing and Systems - Volume 02

Quantified Score

Hi-index	0.00

Visualization

Abstract

Facial expressions and characteristics of speech are exploited intuitively by humans to infer the emotional status of their partners in communication. This paper investigates ways to extract emotion from spontaneous speech, aiming at transferring emotions to appropriate facial expressions of the speaker's virtual representatives. Hence, this paper presents one step towards an emotional speech-driven facial animation system, promises to be the first true non-human animation assistant. Different classifier-algorithms (support vector machines, neural networks, and decision trees) were compared in extracting emotion from speech features. Results show that these machine-learning algorithms outperform human subjects extracting emotion fromspeech alone if there is no access to additional cues onto the emotional state.