Image-based Talking Heads using Radial Basis Functions

  • Authors:
  • James D. Edge;Steve Maddock

  • Affiliations:
  • -;-

  • Venue:
  • TPCG '03 Proceedings of the Theory and Practice of Computer Graphics 2003
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

In recent years talking heads have received a great dealof interest, both in their application to natural human-computerdialogue, and their benefit to the intelligibilityof synthesised speech. A model for the realistic synthesisof visual speech animation is described in this paper. Imagesrepresenting the key visual speech poses (visemes) arepre-recorded and labelled. Transitions between visemes arecreated by using an image morphing technique based uponthe use of Radial Basis Functions. Timing information fromthe Festival speech synthesis system is used to plan the appropriatetransitions to create realistic speech animation. Amodel of coarticulation is included in the system to improvethe realism of articulatory motion.