Assembling an expressive facial animation system

Authors:
Alice Wang;Michael Emmi;Petros Faloutsos
Affiliations:
Northrop Grumman;University of California Los Angeles;University of California Los Angeles
Venue:
Proceedings of the 2007 ACM SIGGRAPH symposium on Video games
Year:
2007

Citing 16
Cited 4

A muscle model for animation three-dimensional facial expression

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents

SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
Realistic modeling for facial animation

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Video Rewrite: driving visual speech with audio

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Making faces

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Synthesizing realistic facial expressions from photographs

Proceedings of the 25th annual conference on Computer graphics and interactive techniques
Voice puppetry

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
A morphable model for the synthesis of 3D faces

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Trainable videorealistic speech animation

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
"May I talk to you?: -)" " Facial Animation from Text

PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
Learning controls for blend shape based realistic facial animation

Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
Unsupervised learning for speech motion editing

Proceedings of the 2003 ACM SIGGRAPH/Eurographics symposium on Computer animation
A parametric model for human faces.

A parametric model for human faces.
Speaking with hands: creating animated conversational characters from recordings of human performance

ACM SIGGRAPH 2004 Papers
Dynamic Animation and Control Environment

GI '05 Proceedings of Graphics Interface 2005
Expressive speech-driven facial animation

ACM Transactions on Graphics (TOG)

Animating Speech in Games

Motion in Games
An extensible framework for interactive facial animation with facial expressions, lip synchronization and eye behavior

Computers in Entertainment (CIE) - SPECIAL ISSUE: Games
Correct speech visemes as a root of total communication method for deaf people

KES-AMSTA'12 Proceedings of the 6th KES international conference on Agent and Multi-Agent Systems: technologies and applications
3D Talking-Head Interface to Voice-Interactive Services on Mobile Phones

International Journal of Mobile Human Computer Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we investigate the development of an expressive facial animation system from publicly available components. There is a great body of work on face modeling, facial animation and conversational agents. However, most of the current research either targets a specific aspect of a conversational agent or is tailored to systems that are not publicly available. We propose a high quality facial animation system that can be easily built based on affordable off-the-shelf components. The proposed system is modular, extensible, efficient and suitable for a wide range of applications that require expressive speaking avatars. We demonstrate the effectiveness of the system with two applications: (a) a text-to-speech synthesizer with expression control and (b) a conversational agent that can react to simple phrases.