Sign language recognition using sub-units

Authors:
Helen Cooper;Eng-Jon Ong;Nicolas Pugeault;Richard Bowden
Affiliations:
Centre for Vision Speech and Signal Processing, University of Surrey, Guildford, UK;Centre for Vision Speech and Signal Processing, University of Surrey, Guildford, UK;Centre for Vision Speech and Signal Processing, University of Surrey, Guildford, UK;Centre for Vision Speech and Signal Processing, University of Surrey, Guildford, UK
Venue:
The Journal of Machine Learning Research
Year:
2012

Citing 9
Cited 2

Shape quantization and recognition with randomized trees

Neural Computation
Random Forests

Machine Learning
A decision-theoretic generalization of on-line learning and an application to boosting

EuroCOLT '95 Proceedings of the Second European Conference on Computational Learning Theory
Modelling and segmenting subunits for sign language recognition based on hand motion analysis

Pattern Recognition Letters
Learning the basic units in American Sign Language using discriminative segmental feature selection

ICASSP '09 Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing
GART: the gesture and activity recognition toolkit

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Large lexicon detection of sign language

HCI'07 Proceedings of the 2007 IEEE international conference on Human-computer interaction
American sign language recognition with the kinect

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Hand tracking and affine shape-appearance handshape sub-units in continuous sign language recognition

ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part I

Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine

Pattern Recognition Letters
One-shot learning gesture recognition from RGB-D data using bag of features

The Journal of Machine Learning Research

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper discusses sign language recognition using linguistic sub-units. It presents three types of sub-units for consideration; those learnt from appearance data as well as those inferred from both 2D or 3D tracking data. These sub-units are then combined using a sign level classifier; here, two options are presented. The first uses Markov Models to encode the temporal changes between sub-units. The second makes use of Sequential Pattern Boosting to apply discriminative feature selection at the same time as encoding temporal information. This approach is more robust to noise and performs well in signer independent tests, improving results from the 54% achieved by the Markov Chains to 76%.