Expressive Face Animation Synthesis Based on Dynamic Mapping Method
ACII '07 Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction
Retrieval based interactive cartoon synthesis via unsupervised bi-distance metric learning
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Realistic visual speech synthesis based on hybrid concatenation method
IEEE Transactions on Audio, Speech, and Language Processing - Special issue on multimodal processing in speech-based interactions
Cartoon synthesis using constrained spreading activation network
Multimedia Tools and Applications
Fuzzy diffusion distance learning for cartoon similarity estimation
Journal of Computer Science and Technology
Dynamic mapping method based speech driven face animation system
ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
ACII'05 Proceedings of the First international conference on Affective Computing and Intelligent Interaction
A cantonese speech-driven talking face using translingual audio-to-visual conversion
ISCSLP'06 Proceedings of the 5th international conference on Chinese Spoken Language Processing
| Hi-index | 0.00 |
This paper describes a morphing-based audio driven facial animation system. Based on an incoming audio stream, a face image is animated with full lip synchronization and synthesized expressions. A novel scheme to implement a language independent system for audio-driven facial animation given a speech recognition system for just one language, in our case, English, is presented. The method presented here can also be used for text to audio-visual speech synthesis. Visemes in new expressions are synthesized to be able to generate animations with different facial expressions. An animation sequence using optical flow between visemes is constructed, given an incoming audio stream and still pictures of a face representing different visemes. The presented techniques give improved lip synchronization and naturalness to the animated video.