Relevant Features for Video-Based Continuous Sign Language Recognition

Authors:
Britta Bauer;Hermann Hienz
Affiliations:
-;-
Venue:
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Year:
2000

Citing 0
Cited 23

Towards an Automatic Sign Language Recognition System Using Subunits

GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Large vocabulary sign language recognition based on hierarchical decision trees

Proceedings of the 5th international conference on Multimodal interfaces
A vision-based sign language recognition system using tied-mixture density HMM

Proceedings of the 6th international conference on Multimodal interfaces
Recognition of sign language subwords based on boosted hidden Markov models

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Gesture-driven American sign language phraselator

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Viewpoint invariant sign language recognition

Computer Vision and Image Understanding
Signing Exact English (SEE): Modeling and recognition

Pattern Recognition
Signing Exact English (SEE): Modeling and recognition

Pattern Recognition
Definition and recovery of kinematic features for recognition of American sign language movements

Image and Vision Computing
Effort analysis in signer-independent sign gestures

Journal of Experimental & Theoretical Artificial Intelligence
A Chinese sign language recognition system based on SOFM/SRN/HMM

Pattern Recognition
A person independent system for recognition of hand postures used in sign language

Pattern Recognition Letters
Recognition of dynamic gestures in arabic sign language using two stages hierarchical scheme

International Journal of Knowledge-based and Intelligent Engineering Systems
Toward natural interaction in the real world: real-time gesture recognition

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Transition movement models for large vocabulary continuous sign language recognition

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Model-based segmentation and recognition of dynamic gestures in continuous video streams

Pattern Recognition
American sign language recognition with the kinect

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Vision-Based sign language recognition using sign-wise tied mixture HMM

PCM'04 Proceedings of the 5th Pacific Rim Conference on Advances in Multimedia Information Processing - Volume Part II
Non parametric, self organizing, scalable modeling of spatiotemporal inputs: The sign language paradigm

Neural Networks
A proposed PCNN features quality optimization technique for pose-invariant 3D Arabic sign language recognition

Applied Soft Computing
Finding recurrent patterns from continuous sign language sentences for automated extraction of signs

The Journal of Machine Learning Research
Gesture spotting and recognition using salience detection and concatenated hidden markov models

Proceedings of the 15th ACM on International conference on multimodal interaction
Towards subject independent continuous sign language recognition: A segment and merge approach

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes the development of a video-based continuous sign language recognition system. The system is based on continuous density Hidden Markov Models (HMM) with one model for each sign. Feature vectors reflecting manual sign parameters serve as input for training and recognition. To reduce computational complexity during the recognition task beam search is employed. The system aims for an automatic signer dependent recognition of sign language sentences, based on a lexicon of 97 sign of German Sign Language (GSL). A single color video camera is used for image recording. Furthermore the influence of different features reflecting different manual sign parameters on the recognition results are examined. Results are given for varying features and varying sized vocabulary. The system achieves accuracy of 91.7% based on a lexicon of 97 signs.