Evaluation of synthetic and natural Mandarin visual speech: Initial consonants, single vowels, and syllables

Authors:
Trevor H. Chen;Dominic W. Massaro
Affiliations:
Department of Psychology, University of California, 1156 High Street, Santa Cruz, CA 95064, United States;Department of Psychology, University of California, 1156 High Street, Santa Cruz, CA 95064, United States
Venue:
Speech Communication
Year:
2011

Citing 3
Cited 0

Real-Time Lip Synchronization Using Wavelet Network

CW '05 Proceedings of the 2005 International Conference on Cyberworlds
Transferring of Speech Movements from Video to 3D Face Space

IEEE Transactions on Visualization and Computer Graphics
Vision based speech animation transferring with underlying anatomical structure

ACCV'06 Proceedings of the 7th Asian conference on Computer Vision - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

Although the auditory aspects of Mandarin speech are relatively more heavily-researched and well-known in the field, this study addresses its visual aspects by examining the perception of both Mandarin natural and synthetic visual speech. In perceptual experiments, the synthetic visual speech of a computer-animated Mandarin talking head was evaluated and subsequently improved. Also, the basic (or ''minimum'') units of Mandarin visual speech were determined for initial consonants and final single-vowels. Overall, the current study achieved solid improvements of synthetic visual speech, and this was one step towards a Mandarin synthetic talking head with realistic speech.