Automatic referent resolution of deictic and anaphoric expressions

Authors:
Carla Huls;Wim Claassen;Edwin Bos
Affiliations:
University of Nijmegen;University of Nijmegen;University of Nijmegen
Venue:
Computational Linguistics
Year:
1995

Citing 9
Cited 20

Computation and cognition: toward a foundation for cognitive science

Computation and cognition: toward a foundation for cognitive science
Attention, intentions, and the structure of discourse

Computational Linguistics
Memory and context for language interpretation

Memory and context for language interpretation
Object-oriented programming in FLAVORS and CommonORBIT

Artificial intelligence programming environments
Intelligent multi-media interface technology

Intelligent user interfaces
The role of natural language in a multimodal interface

UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
Commenting on action: continuous linguistic feedback generation

IUI '93 Proceedings of the 1st international conference on Intelligent user interfaces
EDWARD: full integration of language and action in a multimodal user interface

International Journal of Human-Computer Studies
Generating Referring Expressions in a Multimodal Environment

Proceedings of the 6th International Workshop on Natural Language Generation: Aspects of Automated Natural Language Generation

Why Are Multimodal Systems so Difficult to Build? - About the Difference between Deictic Gestures and Direct Manipulation

CMC '98 Revised Papers from the Second International Conference on Cooperative Multimodal Communication
PEDRO: Assessing Presentation Decodability on the Basis of Empirically Validated Models

CMC '98 Revised Papers from the Second International Conference on Cooperative Multimodal Communication
A probabilistic approach to reference resolution in multimodal user interfaces

Proceedings of the 9th international conference on Intelligent user interfaces
Linguistic theories in efficient multimodal reference resolution: an empirical investigation

Proceedings of the 10th international conference on Intelligent user interfaces
Inferable Centers, Centering Transitions, and the Notion of Coherence

Computational Linguistics
Combining semantic and temporal constraints for multimodal integration in conversation systems

HLT-NAACL-DIALOGUE '03 Proceedings of the HLT-NAACL 2003 workshop on Research directions in dialogue processing - Volume 7
Working with robots and objects: revisiting deictic reference for achieving spatial common ground

Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction
Salience modeling based on non-verbal modalities for spoken language understanding

Proceedings of the 8th international conference on Multimodal interfaces
A salience driven approach to robust input interpretation in multimodal conversational systems

HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Modeling the impact of shared visual information on collaborative reference

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Beyond attention: the role of deictic gesture in intention recognition in multimodal conversational interfaces

Proceedings of the 13th international conference on Intelligent user interfaces
The AMIDA Automatic Content Linking Device: Just-in-Time Document Retrieval in Meetings

MLMI '08 Proceedings of the 5th international workshop on Machine Learning for Multimodal Interaction
Cooperation between pronoun and reference resolution for unrestricted texts

ANARESOLUTION '97 Proceedings of a Workshop on Operational Factors in Practical, Robust Anaphora Resolution for Unrestricted Texts
What's there to talk about?: a multi-modal model of referring behavior in the presence of shared visual information

EACL '06 Proceedings of the Eleventh Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop
Performance evaluation and error analysis for multimodal reference resolution in a conversation system

HLT-NAACL-Short '04 Proceedings of HLT-NAACL 2004: Short Papers
Active and passive gestures: problems with the resolution of deictic and elliptic expressions in a multimodal system

ReferringPhenomena '97 Referring Phenomena in a Multimedia Context and their Computational Treatment
Cognitive principles in robust multimodal interpretation

Journal of Artificial Intelligence Research
Location grounding in multimodal local search

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Interpreting pointing gestures and spoken requests: a probabilistic, salience-based approach

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world

International Journal of Human-Computer Studies

Quantified Score

Hi-index	0.00

Visualization

Abstract

Deictic and anaphoric expressions frequently cause problems for natural language analysis. In this paper we present a single model that accounts for referent resolution of deictic and anaphoric expressions in a research prototype of a multimodal user interface called EDWARD. The linguistic expressions are keyed in by a user and are possibly accompanied by pointing gestures. The proposed model for reference resolution elaborates on Alshawi's (1987) notions of context factors and salience and integrates both linguistic and perceptual context effects. The model is contrasted with two alternative referent resolution models, namely, a simplistic one and the more sophisticated model proposed by Grosz and Sidner (1986). Based on empirical and analytical grounds, we conclude that the model we propose is preferable from a computational and engineering point of view.