Referring to displays in multimodal interfaces

Authors:
Daqing He;Graeme Ritchie;John Lee
Affiliations:
University of Edinburgh, Edinburgh, Scotland;University of Edinburgh, Edinburgh, Scotland;University of Edinburgh, Edinburgh, Scotland
Venue:
ReferringPhenomena '97 Referring Phenomena in a Multimedia Context and their Computational Treatment
Year:
1997

Citing 6
Cited 1

Computer interpretation of natural language descriptions

Computer interpretation of natural language descriptions
Attention, intentions, and the structure of discourse

Computational Linguistics
Intelligent multi-media interface technology

Intelligent user interfaces
Natural Language and Graphics Interface: Results and Perspectives from the ACORD Project

Natural Language and Graphics Interface: Results and Perspectives from the ACORD Project
Enhanced Interaction Styles for User Interfaces

IEEE Computer Graphics and Applications
Graflog: a theory of semantics for graphics with applications to human-computer interaction and cad systems

Graflog: a theory of semantics for graphics with applications to human-computer interaction and cad systems

Resolving References to Graphical Objects in Multimodal Queries by Constraint Satisfaction

ICMI '00 Proceedings of the Third International Conference on Advances in Multimodal Interfaces

Quantified Score

Hi-index	0.00

Visualization

Abstract

A system which displays information graphically, and also allows natural language queries, should allow these queries to interrogate the displayed (visual) information. Ideally this would use some uniform method for processing queries both about the display and about the world model. Such a system would have to cope with ambiguities introduced by these two sources of information. These ambiguities, and a preliminary proposal for a system to deal with it, are the main topics of this paper.