Efficient generation of large amounts of training data for sign language recognition: a semi-automatic tool

Authors:
Ruiduo Yang;Sudeep Sarkar;Barbara Loeding;Arthur Karshmer
Affiliations:
University of South Florida, Tampa, FL;University of South Florida, Tampa, FL;University of South Florida, Lakeland, FL;University of South Florida, Lakeland, FL
Venue:
ICCHP'06 Proceedings of the 10th international conference on Computers Helping People with Special Needs
Year:
2006

Citing 7
Cited 2

Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video

IEEE Transactions on Pattern Analysis and Machine Intelligence
Mean Shift: A Robust Approach Toward Feature Space Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Tools and Techniques for Video Performance Evaluation

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 4
Labeling images with a computer game

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A web-based system for collaborative annotation of large image and video collections: an evaluation and user study

Proceedings of the 13th annual ACM international conference on Multimedia
Dynamic disparity adjustment and histogram-based filtering of range data for fast 3-D hand tracking

Digital Signal Processing

Toward multimodal situated analysis

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Sign segmentation using dynamics and hand configuration for semi-automatic annotation of sign language corpora

GW'11 Proceedings of the 9th international conference on Gesture and Sign Language in Human-Computer Interaction and Embodied Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have developed a video hand segmentation tool which can help with generating hands ground truth from sign language image sequences. This tool may greatly facilitate research in the area of sign language recognition. In this tool, we offer a semi automatic scheme to assist with the localization of hand pixels, which is important for the purpose of recognition. A candidate hand generator is applied by using the mean shift image segmentation algorithm and a greedy seeds growing algorithm. After a number of hand candidates is generated, the user can reduce the candidates by simple mouse clicks. The tool also provides a hand tracking function for faster processing and a face detection function for groundtruthing non manual signals. In addition, we provided a two-passes groundtruthing scheme unlike other tools that only does one-pass. Our first pass processing is automatic and does not need user interaction. The experiment results demonstrate that based on the first pass's result, one can groundtruth 10,000+ frames of sign language within 8 hours