Automatic Translation System to Spanish Sign Language with a Virtual Interpreter

Authors:
Sandra Baldassarri;Eva Cerezo;Francisco Royo-Santas
Affiliations:
Advanced Computer Graphics Group (GIGA), Computer Science Department, Aragon Insittute for Engineering Research (I3A), University of Zaragoza, Spain;Advanced Computer Graphics Group (GIGA), Computer Science Department, Aragon Insittute for Engineering Research (I3A), University of Zaragoza, Spain;Advanced Computer Graphics Group (GIGA), Computer Science Department, Aragon Insittute for Engineering Research (I3A), University of Zaragoza, Spain
Venue:
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Year:
2009

Citing 4
Cited 2

Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning

IEEE Transactions on Pattern Analysis and Machine Intelligence
Chaos and Graphics: Maxine: A platform for embodied animated agents

Computers and Graphics
Real-Time Facial Expression Recognition for Natural Interaction

IbPRIA '07 Proceedings of the 3rd Iberian conference on Pattern Recognition and Image Analysis, Part II
Speech to sign language translation system for Spanish

Speech Communication

A proposed semantic machine translation system for translating Arabic text to Arabic sign language

Proceedings of the Second Kuwait Conference on e-Services and e-Systems
Effect of Displaying Human Videos During an Evaluation Study of American Sign Language Animation

ACM Transactions on Accessible Computing (TACCESS)

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, an automatic translation system from Spanish language into Spanish Sign Language (LSE) performed by a virtual interpreter is presented. The translator is based on rules from Spanish grammar considering the syntactical and morphological characteristics of words and the semantics of their meaning. The system has been incorporated to an animation engine in which a virtual character acts as an interpreter that communicates using LSE. The mood of the interpreter is considered, so that the translation and the signs are modified depending on whether the interpreter is happy, angry, etc. The system has been tested with satisfactory results in speed and quality.