An automatic lip-synchronization algorithm for synthetic faces

  • Authors:
  • K. Waters;T. Levergood

  • Affiliations:
  • Digital Equipment Corporation, Cambridge Research Lab, One Kendall Square, Cambridge, MA;Digital Equipment Corporation, Cambridge Research Lab, One Kendall Square, Cambridge, MA

  • Venue:
  • MULTIMEDIA '94 Proceedings of the second ACM international conference on Multimedia
  • Year:
  • 1994

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper addresses the problem of automatically synchronizing computer-generated faces with synthetic speech. The complete process provides a novel form of face-to-face communication and the ability to create a new range of talking personable synthetic characters. Based on plain ASCII text input, a synthetic speech segment is generated and synchronized in real-time to a graphical display of an articulating mouth and face. The key component of the algorithm is the run-time facility that adaptively synchronizes the graphical display of the face to the audio.