Automatic sign language recognition: vision based feature extraction and probabilistic recognition scheme from multiple cues

Authors:
George Caridakis;Olga Diamanti;Kostas Karpouzis;Petros Maragos
Affiliations:
National Technical University of Athens, Athens, Greece;National Technical University of Athens, Athens, Greece;National Technical University of Athens, Athens, Greece;National Technical University of Athens, Athens, Greece
Venue:
Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments
Year:
2008

Citing 10
Cited 4

Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations

Journal of Computational Physics
Geodesic Active Contours

International Journal of Computer Vision
Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
Parametric Hidden Markov Models for Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Recognizing Temporal Trajectories Using the Condensation Algorithm

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning

IEEE Transactions on Pattern Analysis and Machine Intelligence
Continuous Gesture Recognition using a Sparse Bayesian Classifier

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 01
GSLC: creation and annotation of a Greek sign language corpus for HCI

UAHCI'07 Proceedings of the 4th international conference on Universal access in human computer interaction: coping with diversity
Large vocabulary sign language recognition based on fuzzy decision trees

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans

The transition from web content accessibility guidelines 1.0 to 2.0: what this means for evaluation and repair

Proceedings of the 27th ACM international conference on Design of communication
Influence of handshape information on automatic sign language recognition

GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Design and evaluation of classifier for identifying sign language videos in video sharing sites

Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility
Identifying Sign Language Videos in Video Sharing Sites

ACM Transactions on Accessible Computing (TACCESS)

Quantified Score

Hi-index	0.00

Visualization

Abstract

This work focuses on two of the research problems comprising automatic sign language recognition, namely robust computer vision techniques for consistent hand detection and tracking, while preserving the hand shape contour which is useful for extraction of features related to the handshape and a novel classification scheme incorporating Self-organizing maps, Markov chains and Hidden Markov Models. Geodesic Active Contours enhanced with skin color and motion information are employed for the hand detection and the extraction of the hand silhouette, while features extracted describe hand trajectory, region and shape. Extracted features are used as input to separate classifiers, forming a robust and adaptive architecture whose main contribution is the optimal utilization of the neighboring characteristic of the SOM during the decoding stage of the Markov chain, representing the sign class.