Resolving References to Graphical Objects in Multimodal Queries by Constraint Satisfaction

Authors:
Daqing He;Graeme Ritchie;John Lee
Affiliations:
-;-;-
Venue:
ICMI '00 Proceedings of the Third International Conference on Advances in Multimodal Interfaces
Year:
2000

Citing 6
Cited 0

Computer interpretation of natural language descriptions

Computer interpretation of natural language descriptions
Intelligent multi-media interface technology

Intelligent user interfaces
Artificial Intelligence

Artificial Intelligence
Referring to world objects with text and pictures

COLING '94 Proceedings of the 15th conference on Computational linguistics - Volume 1
References to graphical objects in interactive multimodal queries

Knowledge-Based Systems
Referring to displays in multimodal interfaces

ReferringPhenomena '97 Referring Phenomena in a Multimedia Context and their Computational Treatment

Quantified Score

Hi-index	0.00

Visualization

Abstract

In natural language queries to an intelligent multimodal system, ambiguities related to referring expressions - source ambiguities - can occur between items in the visual display and objects in the domain being represented. A multimodal interface has to be able to resolve these ambiguities in order to provide satisfactory communication with a user. In this paper, we briefly introduce source ambiguities, and present the formalisation of a constraint satisfaction approach to interpreting singular referring expressions with source ambiguities. In our approach, source ambiguities are resolved simultaneously with other referent ambiguities, allowing flexible access to various sorts of knowledge.