Agora: a GUI approach to multimodal user interfaces

Authors:
Manolis M. Tsangaris;Alexandros Potamianos
Affiliations:
Lucent Technologies, Murray Hill, NJ;Lucent Technologies, Murray Hill, NJ
Venue:
HLT '02 Proceedings of the second international conference on Human Language Technology Research
Year:
2002

Citing 2
Cited 0

Voice Application Development with Voice XML

Voice Application Development with Voice XML
Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions

Human-Computer Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

Multi-modal user interfaces bring the best of the two worlds to the user; the navigational aspect of graphical user interfaces and the declarative aspect of voice interfaces. The user can move around forms providing a concrete visual representation, while speech input allows natural form filling and form navigation. Unlike the unimodal speech interfaces, the visual interface efficiently reflects the state of the dialog as well as the speech recognition and understanding results. Agora uses a hierarchical form flow motivated from the traditional GUI design philosophy and is loosely based on VoiceXML. Agora also brings up several design issues including: ambiguity resolution, modality synchronization, focus representation, preferred modality for input and output.