A person independent system for recognition of hand postures used in sign language

Authors:
Daniel Kelly;John McDonald;Charles Markham
Affiliations:
Computer Science Department, National University of Ireland Maynooth, Maynooth, Co. Kildare, Ireland;Computer Science Department, National University of Ireland Maynooth, Maynooth, Co. Kildare, Ireland;Computer Science Department, National University of Ireland Maynooth, Maynooth, Co. Kildare, Ireland
Venue:
Pattern Recognition Letters
Year:
2010

Citing 19
Cited 7

Sign language recognition: an application of the theory of size functions

BMVC '95 Proceedings of the 6th British conference on Machine vision (Vol. 2)
Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review

IEEE Transactions on Pattern Analysis and Machine Intelligence
Sign language recognition using model-based tracking and a 3D Hopfield neural network

Machine Vision and Applications
Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
Appearance-based hand sign recognition from intensity image sequences

Computer Vision and Image Understanding
Recognition of gestures in Arabic sign language using neuro-fuzzy systems

Artificial Intelligence
Vision-Based Gesture Recognition: A Review

GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
Relevant Features for Video-Based Continuous Sign Language Recognition

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
A Novel Two-Layer PCA/MDA Scheme for Hand Posture Recognition

ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1 - Volume 1
Recognition of Local Features for Camera-Based Sign Language Recognition System

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 4
Recognising Moving Hand Shapes

ICIAP '03 Proceedings of the 12th International Conference on Image Analysis and Processing
Probability Estimates for Multi-class Classification by Pairwise Coupling

The Journal of Machine Learning Research
Automatic Recognition of Colloquial Australian Sign Language

WACV-MOTION '05 Proceedings of the IEEE Workshop on Motion and Video Computing (WACV/MOTION'05) - Volume 2 - Volume 02
Hand Posture Classification and Recognition using the Modified Census Transform

FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
Hand gesture modelling and recognition involving changing shapes and trajectories, using a Predictive EigenTracker

Pattern Recognition Letters
A note on Platt's probabilistic outputs for support vector machines

Machine Learning
Sign Language Spotting with a Threshold Model Based on Conditional Random Fields

IEEE Transactions on Pattern Analysis and Machine Intelligence
User-adaptive hand gesture recognition system with interactive training

Image and Vision Computing
Large lexicon detection of sign language

HCI'07 Proceedings of the 2007 IEEE international conference on Human-computer interaction

Enhancing hand gesture recognition using fuzzy clustering-based mixture-of-experts model

Proceedings of the 5th International Conference on Ubiquitous Information Management and Communication
Adaptive mixture-of-experts models for data glove interface with multiple users

Expert Systems with Applications: An International Journal
Local Binary Pattern based features for sign language recognition

Pattern Recognition and Image Analysis
Attention Based Detection and Recognition of Hand Postures Against Complex Backgrounds

International Journal of Computer Vision
A robust static hand gesture recognition system using geometry based normalizations and Krawtchouk moments

Pattern Recognition
Automatic recognition of object size and shape via user-dependent measurements of the grasping hand

International Journal of Human-Computer Studies
Thai sign language translation using Scale Invariant Feature Transform and Hidden Markov Models

Pattern Recognition Letters

Quantified Score

Hi-index	0.10

Visualization

Abstract

We present a novel user independent framework for representing and recognizing hand postures used in sign language. We propose a novel hand posture feature, an eigenspace Size Function, which is robust to classifying hand postures independent of the person performing them. An analysis of the discriminatory properties of our proposed eigenspace Size Function shows a significant improvement in performance when compared to the original unmodified Size Function. We describe our support vector machine based recognition framework which uses a combination of our eigenspace Size Function and Hu moments features to classify different hand postures. Experiments, based on two different hand posture data sets, show that our method is robust at recognizing hand postures independent of the person performing them. Our method also performs well compared to other user independent hand posture recognition systems.