A Vision-Based Method for Recognizing Non-manual Information in Japanese Sign Language

Authors:
Ming Xu;Bisser Raytchev;Katsuhiko Sakaue;Osamu Hasegawa;Atsuko Koizumi;Masaru Takeuchi;Hirohiko Sagawa
Affiliations:
-;-;-;-;-;-;-
Venue:
ICMI '00 Proceedings of the Third International Conference on Advances in Multimodal Interfaces
Year:
2000

Citing 5
Cited 0

Human motion analysis: a review

Computer Vision and Image Understanding
User-independent online gesture recognition by relative motion extraction

Pattern Recognition Letters
A Method for Recognizing a Sequence of Sign Language Words Represented in a Japanese Sign Language Sentence

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Face Detection Using Mixtures of Linear Subspaces

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Motion-Based Recognition

Motion-Based Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a vision-based method for recognizing the nonmanual information in Japanese Sign Language (JSL). This new modality information provides grammatical constraints useful for JSL word segmentation and interpretation. Our attention is focused on head motion, the most dominant non-manual information in JSL. We designed an interactive color-modeling scheme for robust face detection. Two video cameras are vertically arranged to take the frontal and profile image of the JSL user, and head motions are classified into eleven patterns. Moment-based feature and statistical motion feature are adopted to represent these motion patterns. Classification of the motion features is performed with linear discrimant analysis method. Initial experimental results show that the method has good recognition rate and can be realized in real-time.