A Parallel Multistream Model for Integration of Sign Language Recognition and Lip Motion

Authors:
Jiyong Ma;Wen Gao;Rui Wang
Affiliations:
-;-;-
Venue:
ICMI '00 Proceedings of the Third International Conference on Advances in Multimodal Interfaces
Year:
2000

Citing 2
Cited 2

A Continuous Chinese Sign Language Recognition System

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
A multiband approach to automatic speech recognition

A multiband approach to automatic speech recognition

Non parametric, self organizing, scalable modeling of spatiotemporal inputs: The sign language paradigm

Neural Networks
Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine

Pattern Recognition Letters

Quantified Score

Hi-index	0.00

Visualization

Abstract

The parallel multistream model is proposed for integration sign language recognition and lip motion. The different time scales existing in sign language and lip motion can be tackled well using this approach. Primary experimental results have shown that this approach is efficient for integration of sign language recognition and lip motion. The promising results indicated that parallel multistream model can be a good solution in the framework of multimodal data fusion. An approach to recognize sign language with scalability with the size of vocabulary and a fast approach to locate lip corners are also proposed in this paper.