Sign language recognition using kinect

Authors:
Simon Lang;Marco Block;Raúl Rojas
Affiliations:
Institut für Informatik und Mathematik, Freie Universität Berlin, Berlin, Germany;Institut für Informatik und Mathematik, Freie Universität Berlin, Berlin, Germany;Institut für Informatik und Mathematik, Freie Universität Berlin, Berlin, Germany
Venue:
ICAISC'12 Proceedings of the 11th international conference on Artificial Intelligence and Soft Computing - Volume Part I
Year:
2012

Citing 4
Cited 1

Training Hidden Markov Models with Multiple Observations-A Combinatorial Method

IEEE Transactions on Pattern Analysis and Machine Intelligence
Real-time American Sign Language recognition from video using hidden Markov models

ISCV '95 Proceedings of the International Symposium on Computer Vision
ASL Recognition Based on a Coupling Between HMMs and 3D Motion Analysis

ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Recognizing Spatiotemporal Gestures and Movement Epenthesis in Sign Language

IMVIP '09 Proceedings of the 2009 13th International Machine Vision and Image Processing Conference

Exploring body language as narrative interface

ICIDS'12 Proceedings of the 5th international conference on Interactive Storytelling

Quantified Score

Hi-index	0.00

Visualization

Abstract

An open source framework for general gesture recognition is presented and tested with isolated signs of sign language. Other than common systems for sign language recognition, this framework makes use of Kinect, a depth camera which makes real-time 3D-reconstruction easily applicable. Recognition is done using hidden Markov models with a continuous observation density. The framework also offers an easy way of initializing and training new gestures or signs by performing them several times in front of the camera. First results with a recognition rate of 97% show that depth cameras are well-suited for sign language recognition.