Toward Perceptually Realistic Talking Heads: Models, Methods, and McGurk

Authors:
Darren Cosker;Susan Paddock;David Marshall;Paul L. Rosin;Simon Rushton
Affiliations:
School of Computer Science, Cardiff University, U.K;School of Psychology, Cardiff University, U.K;School of Computer Science, Cardiff University, U.K;School of Computer Science, Cardiff University, U.K;School of Psychology, Cardiff University, U.K
Venue:
ACM Transactions on Applied Perception (TAP)
Year:
2005

Citing 12
Cited 1

A muscle model for animation three-dimensional facial expression

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Computer facial animation

Computer facial animation
Video Rewrite: driving visual speech with audio

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Voice puppetry

Proceedings of the 26th annual conference on Computer graphics and interactive techniques
Active Appearance Models

IEEE Transactions on Pattern Analysis and Machine Intelligence
Discrete Time Processing of Speech Signals

Discrete Time Processing of Speech Signals
Trainable videorealistic speech animation

Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Computer generated animation of faces

ACM '72 Proceedings of the ACM annual conference - Volume 1
Geometry-based muscle modeling for facial animation

GRIN'01 No description on Graphics interface 2001
MikeTalk: A Talking Facial Display Based on Morphing Visemes

CA '98 Proceedings of the Computer Animation
Training a Talking Head

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Photo-realistic talking-heads from image samples

IEEE Transactions on Multimedia

Perceptually guided expressive facial animation

Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Motivated by the need for an informative, unbiased, and quantitative perceptual method for the evaluation of a talking head we are developing, we propose a new test based on the “McGurk Effect.” Our approach helps to identify strengths and weaknesses in visual--speech synthesis algorithms for talking heads and facial animations, in general, and uses this insight to guide further development. We also evaluate the behavioral quality of our facial animations in comparison to real-speaker footage and demonstrate our tests by applying them to our current speech-driven facial animation system.