Conversion of continuous speech sound to articulation animation as an application of visual coarticulation modeling

Authors:
Gergely Feldhoffer;Tamás Bárdi
Affiliations:
Pázmány Péter Catholic University, Faculty of Information Technology, Budapest, Hungary;Pázmány Péter Catholic University, Faculty of Information Technology, Budapest, Hungary
Venue:
Acta Cybernetica
Year:
2007

Citing 2
Cited 0

Speech driven facial animation

Proceedings of the 2001 workshop on Perceptive user interfaces
Simulating speech with a physics-based facial muscle model

Proceedings of the 2006 ACM SIGGRAPH/Eurographics symposium on Computer animation

Quantified Score

Hi-index	0.00

Visualization

Abstract

A voice to facial animation conversion system is presented in this paper. In particular the temporal structure of the multimodal speech is discussed. Mutual information and neural network training is used to estimate the optimal temporal scope for audio to video conversion.