Multimodal synthesizer for russian and czech sign languages and audio-visual speech

Authors:
Alexey Karpov;Zdenek Krnoul;Milos Zelezny;Andrey Ronzhin
Affiliations:
St. Petersburg State University, St. Petersburg, Russia,St. Petersburg Institute for Informatics and Automation of RAS (SPIIRAS), Russia;University of West Bohemia (UWB), Pilsen, Czech Republic;University of West Bohemia (UWB), Pilsen, Czech Republic;St. Petersburg Institute for Informatics and Automation of RAS (SPIIRAS), Russia
Venue:
UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: design methods, tools, and interaction techniques for eInclusion - Volume Part I
Year:
2013

Citing 6
Cited 0

Design, implementation and evaluation of the Czech realistic audio-visual speech synthesis

Signal Processing - Special section: Multimodal human-computer interfaces
Translation and conversion for Czech sign speech synthesis

TSD'07 Proceedings of the 10th international conference on Text, speech and dialogue
Czech text-to-sign speech synthesizer

MLMI'07 Proceedings of the 4th international conference on Machine learning for multimodal interaction
The SignCom system for data-driven animation of interactive virtual signers: Methodology and Evaluation

ACM Transactions on Interactive Intelligent Systems (TiiS)
Web-based sign language synthesis and animation for on-line assistive technologies

The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility
Czech-Sign speech corpus for semantic based machine translation

TSD'06 Proceedings of the 9th international conference on Text, Speech and Dialogue

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a model of a computer-animated avatar for the Russian and Czech sign languages. Basic principles of sign language(s) and their implementation in a computer model are briefly sketched. Particular attention is paid to animation principles of the "talking head", which allows for maximum expansion of the functions of the program, making it suitable not only for deaf and hard-of-hearing people, but for blind and non-disabled people too, so the universal audio-visual synthesizer is proposed.