HandTalker: A Multimodal Dialog System Using Sign Language and 3-D Virtual Human

Authors:
Wen Gao;Jiyong Ma;Shiguan Shan;Xilin Chen;Wei Zheng;Hongming Zhang;Jie Yan;Jiangqin Wu
Affiliations:
-;-;-;-;-;-;-;-
Venue:
ICMI '00 Proceedings of the Third International Conference on Advances in Multimodal Interfaces
Year:
2000

Citing 2
Cited 2

Feature extraction from faces using deformable templates

International Journal of Computer Vision
A Continuous Chinese Sign Language Recognition System

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000

Signer-Independent Continuous Sign Language Recognition Based on SRN/HMM

GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Vision-Based sign language recognition using sign-wise tied mixture HMM

PCM'04 Proceedings of the 5th Pacific Rim Conference on Advances in Multimedia Information Processing - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we describe HandTalker: a system we designed for making friendly communication reality between deaf people and normal hearing society. The system consists of GTS (Gesture/Sign language To Spoken language) part and STG (Spoken language To Gesture/Sign language) part. GTS is based on the technology of sign language recognition, and STG is based on 3D virtual human synthesis. Integration of the sign language recognition and 3D virtual human techniques greatly improves the system performance. The computer interface for deaf people is data-glove, camera and computer display, and the interface for hearing-abled is microphone, keyboard, and display. HandTalker now can support no domain limited and continuously communication between deaf and hearing-abled Chinese people.