Class-based n-gram models of natural language
Computational Linguistics
Tessa, a system to aid communication with deaf people
Proceedings of the fifth international ACM conference on Assistive technologies
A systematic comparison of various statistical alignment models
Computational Linguistics
Automated generalization of translation examples
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning
IEEE Transactions on Pattern Analysis and Machine Intelligence
BLEU: a method for automatic evaluation of machine translation
ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Statistical phrase-based translation
NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Universal Access in the Information Society
SmartBody: behavior realization for embodied conversational agents
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
Speech to sign language translation system for Spanish
Speech Communication
Greta: an interactive expressive ECA system
Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 2
Statistical Machine Translation
Statistical Machine Translation
Spoken Spanish generation from sign language
Interacting with Computers
A MULTIAGENT ARCHITECTURE FOR 3D RENDERING OPTIMIZATION
Applied Artificial Intelligence
Persian sign language (PSL) recognition using wavelet transform and neural networks
Expert Systems with Applications: An International Journal
Toward automatic sign language recognition from web3D based scenes
ICCHP'10 Proceedings of the 12th international conference on Computers helping people with special needs
Automatic categorization for improving Spanish into Spanish Sign Language machine translation
Computer Speech and Language
Design, development and field evaluation of a Spanish into sign language translation system
Pattern Analysis & Applications
Methodology for developing an advanced communications system for the Deaf in a new domain
Knowledge-Based Systems
| Hi-index | 12.05 |
This paper describes a new version of a speech into sign language translation system with new tools and characteristics for increasing its adaptability to a new task or a new semantic domain. This system is made up of a speech recognizer (for decoding the spoken utterance into a word sequence), a natural language translator (for converting a word sequence into a sequence of signs belonging to the sign language), and a 3D avatar animation module (for playing back the signs). In order to increase the system adaptability, this paper presents new improvements in all the three main modules for generating automatically the task dependent information from a parallel corpus: automatic generation of Spanish variants when generating the vocabulary and language model for the speech recogniser, an acoustic adaptation module for the speech recogniser, data-oriented language and translation models for the machine translator and a list of signs to design. The avatar animation module includes a new editor for rapidly design of the required signs. These developments have been necessary to reduce the effort when adapting a Spanish into Spanish sign language (LSE: Lengua de Signos Espanola) translation system to a new domain. The whole translation presents a SER (Sign Error Rate) lower than 10% and a BLEU higher than 90% while the effort for adapting the system to a new domain has been reduced more than 50%.