Speech Driven Facial Animation using a Hidden Markov Coarticulation Model

  • Authors:
  • Darren Cosker;Dave Marshall;Paul. L. Rosin;Yulia Hicks

  • Affiliations:
  • Cardiff University, UK;Cardiff University, UK;Cardiff University, UK;Cardiff University, UK

  • Venue:
  • ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 1 - Volume 01
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a hierarchical image based facial model which is driven from speech. It incorporates a novel modelling and synthesis algorithm for learning and producing coarticulated mouth animation We demonstrate using the hierarchical model how animation of the entire face may be created solely from animations of the mouth and how colour may be reincorporated and reproduced compactly without explicitly being modelled. We then consider and evaluate methods of merging animations from several different facial areas for delivery of output.