High level knowledge sources in usable speech recognition systems
Communications of the ACM
Verbal versus pictorial representations of objects in a human-computer interface
International Journal of Man-Machine Studies
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems
Task integration in multimodal speech recognition environments
Crossroads - Special issue on human computer interaction
Put that where? voice and gesture at the graphics interface
ACM SIGGRAPH Computer Graphics
Building a Speech Interface to a Medical Diagnostic System
IEEE Expert: Intelligent Systems and Their Applications
Adding intelligence to the interface
VRAIS '96 Proceedings of the 1996 Virtual Reality Annual International Symposium (VRAIS 96)
Resolution of referring expressions in a Korean multimodal dialogue system
ACM Transactions on Asian Language Information Processing (TALIP)
"Move the couch where?": developing an augmented reality multimodal interface
ISMAR '06 Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality
Formal framework and necessary properties of the fusion of input modes in user interfaces
Interacting with Computers
Adding speech recognition support to UML tools
Journal of Visual Languages and Computing
MozArt: a multimodal interface for conceptual 3D modeling
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
An evaluation of an augmented reality multimodal interface using speech and paddle gestures
ICAT'06 Proceedings of the 16th international conference on Advances in Artificial Reality and Tele-Existence
Demonstration of sketch-thru-plan: a multimodal interface for command and control
Proceedings of the 15th ACM on International conference on multimodal interaction
| Hi-index | 4.10 |
A description is given of a workstation with integrated graphical and voice I/O (input/output), to improve the man-machine interface (MMI) of the Airborne Warning and Control System (AWACS). Incremental prototype development is used to improve the MMI for AWACS. Operator tasks were analyzed to identify functions that would be better performed with voice I/O, and a 70-word vocabulary and corresponding grammar were developed for an ITT VRS-1280 speech recognizer. Responses for a DEC Talker speech synthesizer were also developed. The system architecture for integrating voice and graphical input in the AWACS interface prototype and its implementation are described and development issues are examined. Future developments are considered.