Real-time speech motion synthesis from recorded motions

  • Authors:
  • Yong Cao;Petros Faloutsos;Eddie Kohler;Frédéric Pighin

  • Affiliations:
  • University of California at Los Angeles;University of California at Los Angeles;University of California at Los Angeles;University of Southern California

  • Venue:
  • SCA '04 Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Data-driven approaches have been successfully used for realistic visual speech synthesis. However, little effort has been devoted to real-time lip-synching for interactive applications. In particular, algorithms that are based on a graph of motions are notorious for their exponential complexity. In this paper, we present a greedy graph search algorithm that yields vastly superior performance and allows real-time motion synthesis from a large database of motions. The time complexity of the algorithm is linear with respect to the size of an input utterance. In our experiments, the synthesis time for an input sentence of average length is under a second.