A cross-linguistic study on the production of multimodal referring expressions in dialogue

Authors:
Ielka van der Sluis;Saturnino Luz
Affiliations:
University of Groningen, the Netherlands;Trinity College Dublin, Ireland
Venue:
ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
Year:
2011

Citing 14
Cited 1

The agreement process: an empirical investigation of human—human computer-mediated collaborative dialogs

International Journal of Human-Computer Studies - Special issue on collaboration, cooperation and conflict in dialogue systems
Generating referring expressions: boolean extensions of the incremental algorithm

Computational Linguistics
Graph-based generation of referring expressions

Computational Linguistics
Generating minimal definite descriptions

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Generating Referring Expressions that Involve Gradable Properties

Computational Linguistics
A Japanese corpus of referring expressions used in a situated collaboration task

ENLG '09 Proceedings of the 12th European Workshop on Natural Language Generation
Evaluating an Algorithm for the Generation of Multimodal Referring Expressions in a Virtual World: A Pilot Study

IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Learning content selection rules for generating object descriptions in dialogue

Journal of Artificial Intelligence Research
Group-based generation of referring expressions

INLG '06 Proceedings of the Fourth International Natural Language Generation Conference
From TUNA attribute sets to Portuguese text: a first report

INLG '08 Proceedings of the Fifth International Natural Language Generation Conference
Cross-linguistic attribute selection for REG: comparing Dutch and English

INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Coping with temporal constraints in multimedia presentation planning

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
Production of demonstratives in Dutch, English and Portuguese dialogues

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world

International Journal of Human-Computer Studies

Production of demonstratives in Dutch, English and Portuguese dialogues

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a cross-linguistic data elicitation study on fully realised referring expressions (REs) in a dialogue context. A webbased experiment was set up in which participants were asked to choose REs to be uttered by one of two agents for identifying five targets in a scripted dialogue. Participants were told that the agent would point at the referents while uttering their chosen linguistic descriptions. The study was conducted in English, Japanese, Portuguese and Dutch and yielded a total of 1190 referring expressions. Our hypotheses concern sets of objects that need to be considered for identification depending on the effect of the pointing gesture. Results show interesting and significant differences between the language groups.