SHARK2: a large vocabulary shorthand writing system for pen-based computers
Proceedings of the 17th annual ACM symposium on User interface software and technology
EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
Non-syntactic word prediction for AAC
SLPAT '12 Proceedings of the Third Workshop on Speech and Language Processing for Assistive Technologies
Semantic disambiguation of non-syntactic and continuous motion text entry for AAC
ACM SIGACCESS Accessibility and Computing
| Hi-index | 0.00 |
Augmentative and alternative communication (AAC) systems are often used by individuals with severe speech impairments. Icon-based AAC systems typically present users with arrays of icons that are sequentially selected to construct utterances, which are then spoken aloud using text-to-speech (TTS) synthesis. For touch-screen devices, users must lift their finger or hand to select individual icons and avoid selecting multiple icons at once. Because many individuals with severe speech impairments have concomitant limb impairments, repetitive and precise movements can be slow and effortful. The current work aims to enhance message formulation ease and speed by using continuous motion icon selection rather than discrete input. SymbolPath is an overlay module that can be integrated with existing icon-based AAC systems to enable continuous motion icon selection. Message formulation using SymbolPath consists of drawing a continuous path through a set of desired icons. The system then determines the most likely subset of desired icons on that path and rearranges them to form a meaningful and grammatical sentence. In addition to demonstrating the SymbolPath module, we plan to present usability data and discuss iterative modifications to the software.