Rapid Signer Adaptation for Isolated Sign Language Recognition

Authors:
Ulrich von Agris;Daniel Schneider;Jorg Zieren;Karl-Friedrich Kraiss
Affiliations:
RWTH Aachen University, Germany;RWTH Aachen University, Germany;RWTH Aachen University, Germany;RWTH Aachen University, Germany
Venue:
CVPRW '06 Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop
Year:
2006

Citing 0
Cited 10

Person-Independent 3D Sign Language Recognition

Gesture-Based Human-Computer Interaction and Simulation
Enhancing a Sign Language Translation System with Vision-Based Features

Gesture-Based Human-Computer Interaction and Simulation
Modelling and recognition of the linguistic components in American Sign Language

Image and Vision Computing
A framework for continuous multimodal sign language recognition

Proceedings of the 2009 international conference on Multimodal interfaces
Spoken Spanish generation from sign language

Interacting with Computers
Toward natural interaction in the real world: real-time gesture recognition

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
User-independent recognition of Arabic sign language for facilitating communication with the deaf community

Digital Signal Processing
LSESpeak: A spoken language generator for Deaf people

Expert Systems with Applications: An International Journal
Towards subject independent continuous sign language recognition: A segment and merge approach

Pattern Recognition
Methodology for developing an advanced communications system for the Deaf in a new domain

Knowledge-Based Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Research in the field of sign language recognition has not yet addressed the problem of interpersonal variance in large vocabulary on the classification level. Current recognition systems are designed for signer-dependent operation. Applied to signer-independent tasks, they show poor performance even when increasing the number of training signers. Better results can be achieved with dedicated adaptation methods. This paper describes a vision-based recognition system that quickly adapts to unknown signers. A combination of Maximum Likelihood Linear Regression and Maximum A Posteriori estimation was implemented and modified to consider the specifics of sign languages, such as one-handed signs. An extensive evaluation was performed in supervised and unsupervised mode on a vocabulary of 153 isolated signs. The proposed adaptation approach significantly increases accuracy even with a small amount of adaptation data. Supervised adaptation with 80 adaptation sequences yields a recognition accuracy of 78.6%, which is a relative improvement of 41.6% compared to the signerindependent baseline.