Multimodal Cooperative Resolution of Referential Expressions in the DenK System

Authors:
Leen Kievit;Paul Piwek;Robbert-Jan Beun;Harry Bunt
Affiliations:
-;-;-;-
Venue:
CMC '98 Revised Papers from the Second International Conference on Cooperative Multimodal Communication
Year:
1998

Citing 6
Cited 7

Attention, intentions, and the structure of discourse

Computational Linguistics
Memory and context for language interpretation

Memory and context for language interpretation
Lambda calculi with types

Handbook of logic in computer science (vol. 2)
Multimodal Cooperation with the DENK System

Multimodal Human-Computer Communication, Systems, Techniques, and Experiments
Issues in Multimodal Human-Computer Communication

Multimodal Human-Computer Communication, Systems, Techniques, and Experiments
Providing a unified account of definite noun phrases in discourse

ACL '83 Proceedings of the 21st annual meeting on Association for Computational Linguistics

Visual Salience and Reference Resolution in Simulated 3-D Environments

Artificial Intelligence Review
Dynamically structuring, updating and interrelating representations of visual and linguistic discourse context

Artificial Intelligence - Special volume on connecting language to the world
Visual perception, language and gesture: a model for their understanding in multimodal dialogue systems

Signal Processing - Special section: Multimodal human-computer interfaces
Attention driven reference resolution in multimodal contexts

Artificial Intelligence Review
Dynamically structuring, updating and interrelating representations of visual and linguistic discourse context

Artificial Intelligence - Special volume on connecting language to the world
The semantics of dialogue acts

IWCS '11 Proceedings of the Ninth International Conference on Computational Semantics
Modeling context for referring in multimodal dialogue systems

CONTEXT'05 Proceedings of the 5th international conference on Modeling and Using Context

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present an approach to the resolution of multimodal referential expressions in a cooperative human-machine communication setting, provided by the DenK system. We discuss how references involving multiple modalities are resolved, and we also indicate how the system can respond cooperatively in case the resolution process fails.