Whole-hand input
A Hybrid Sign Language Recognition System
ISWC '04 Proceedings of the Eighth International Symposium on Wearable Computers
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning
IEEE Transactions on Pattern Analysis and Machine Intelligence
Real-Time Natural Hand Gestures
Computing in Science and Engineering
An immersive virtual environment for learning sign language mathematics
ACM SIGGRAPH 2006 Educators program
SMILE: an immersive learning game for deaf and hearing children
ACM SIGGRAPH 2007 educators program
Dynamic Bayesian networks for visual recognition of dynamic gestures
Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology - IBERAMIA '02
Numerical input techniques for immersive virtual environments
VECIMS'09 Proceedings of the 2009 IEEE international conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems
Human-virtual human interaction by upper body gesture understanding
Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology
| Hi-index | 0.00 |
The general goal of our research is the creation of a natural and intuitive interface for navigation, interaction, and input/recognition of American Sign Language (ASL) math signs in immersive Virtual Environments (VE) for the Deaf. The specific objective of this work is the development of two new gesture recognition systems for SMILE™, an immersive learning game that employs a fantasy 3D virtual environment to engage deaf children in math-based educational tasks. Presently, SMILE includes standard VR interaction devices such as a 6DOF wand, a pair of pinch gloves, and a dance platform. In this paper we show a significant improvement of the application by proposing two new gesture control mechanisms: system (1) is based entirely on hand gestures and makes use of a pair of 18-sensor data gloves, system (2) is based on hand and body gestures and makes use of a pair of data gloves and a motion tracking system. Both interfaces support first-person motion control, object selection and manipulation, and real-time input/recognition of ASL numbers zero to twenty. Although the systems described in the paper rely on high-end, expensive hardware, they can be considered a first step toward the realization of an effective immersive sign language interface.