Assistive technology computers and persons with disabilities
Communications of the ACM
Video Rewrite: driving visual speech with audio
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video
IEEE Transactions on Pattern Analysis and Machine Intelligence
Foundations of statistical natural language processing
Foundations of statistical natural language processing
A framework for recognizing the simultaneous aspects of American sign language
Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
Trainable videorealistic speech animation
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Motion texture: a two-level statistical model for character motion synthesis
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Interactive motion generation from examples
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Interactive control of avatars animated with human motion data
Proceedings of the 29th annual conference on Computer graphics and interactive techniques
Pattern Recognition in Speech and Language Processing
Pattern Recognition in Speech and Language Processing
Teaching Communication Skills to Hearing-Impaired Children
IEEE MultiMedia
Toward Scalability in ASL Recognition: Breaking Down Signs into Phonemes
GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
SignSynth: A Sign Language Synthesis Application Using Web3D and Perl
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Synthetic Animation of Deaf Signing Gestures
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Representation of american sign language for machine translation
Representation of american sign language for machine translation
CSLDS: Chinese Sign Language Dialog System
AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Error-Tolerant Sign Retrieval Using Visual Features and Maximum A Posteriori Estimation
IEEE Transactions on Pattern Analysis and Machine Intelligence
The mathematics of statistical machine translation: parameter estimation
Computational Linguistics - Special issue on using large corpora: II
Real-time speech motion synthesis from recorded motions
SCA '04 Proceedings of the 2004 ACM SIGGRAPH/Eurographics symposium on Computer animation
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning
IEEE Transactions on Pattern Analysis and Machine Intelligence
A parametric approach to sign language synthesis
Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Transfer-based statistical translation of Taiwanese sign language using PCFG
ACM Transactions on Asian Language Information Processing (TALIP)
Image and video for hearing impaired people
Journal on Image and Video Processing
Evaluation of a psycholinguistically motivated timing model for animations of american sign language
Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility
Enhancing a Sign Language Translation System with Vision-Based Features
Gesture-Based Human-Computer Interaction and Simulation
A Linguistically Motivated Model for Speed and Pausing in Animations of American Sign Language
ACM Transactions on Accessible Computing (TACCESS)
UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
IEEE Transactions on Audio, Speech, and Language Processing
Spoken Spanish generation from sign language
Interacting with Computers
Collecting a motion-capture corpus of American Sign Language for data-driven generation research
SLPAT '10 Proceedings of the NAACL HLT 2010 Workshop on Speech and Language Processing for Assistive Technologies
Why is the creation of a virtual signer challenging computer animation?
MIG'10 Proceedings of the Third international conference on Motion in games
Improving accessibility to web documents for the aurally challenged with sign language animation
Proceedings of the International Conference on Web Intelligence, Mining and Semantics
ACM Transactions on Interactive Intelligent Systems (TiiS)
Enhancing readability of web documents by text augmentation for deaf people
Proceedings of the 3rd International Conference on Web Intelligence, Mining and Semantics
Integrating MultiWordNet with Italian Sign Language lexical resources
Expert Systems with Applications: An International Journal
A rule-based translation from written Spanish to Spanish Sign Language glosses
Computer Speech and Language
| Hi-index | 0.15 |
This work proposes a novel approach to translate Chinese to Taiwanese sign language and to synthesize sign videos. An aligned bilingual corpus of Chinese and Taiwanese Sign Language (TSL) with linguistic and signing information is also presented for sign language translation. A two-pass alignment in syntax level and phrase level is developed to obtain the optimal alignment between Chinese sentences and Taiwanese sign sequences. For sign video synthesis, a scoring function is presented to develop motion transition-balanced sign videos with rich combinations of intersign transitions. Finally, the maximum a posteriori (MAP) algorithm is employed for sign video synthesis based on joint optimization of two-pass word alignment and intersign epenthesis generation. Several experiments are conducted in an educational environment to evaluate the performance on the comprehension of sign expression. The proposed approach outperforms the IBM Model 2 in sign language translation. Moreover, deaf students perceived sign videos generated by the proposed method to be satisfactory.