Multimodal input for computer access and augmentative communication
Assets '96 Proceedings of the second annual ACM conference on Assistive technologies
The use of gestures in multimodal input
Assets '98 Proceedings of the third international ACM conference on Assistive technologies
The contrastive evaluation of unimodal and multimodal interfaces for voice otput communication aids
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Optically sensing tongue gestures for computer input
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Quantitative and Comparative Assessment of Learning in a Tongue-Operated Computer Input Device
IEEE Transactions on Information Technology in Biomedicine
| Hi-index | 0.00 |
In this paper, we are presenting a new wireless and wearable assistive technology called dual-mode Tongue Drive System (dTDS), which is designed to allow people with severe disabilities use computers more effectively with increased speed, flexibility, usability, and independence through their tongue motion and speech. The dTDS detects users' tongue motion using a magnetic tracer and an array of magnetic sensors embedded in a compact, ergonomic, and stylish wireless headset. It also captures users' voice wirelessly using a small microphone on the same headset in a highly integrated fashion. Preliminary evaluation results based on 14 able-bodied subjects indicate that the dTDS headset combined with a commercially available speech recognition software can provide end users with significantly higher performance than either unimodal forms based on tongue motion or speech alone, particularly in completing tasks that require both pointing and text entry.