Evaluating an Algorithm for the Generation of Multimodal Referring Expressions in a Virtual World: A Pilot Study

Authors:
Werner Breitfuss;Ielka Sluis;Saturnino Luz;Helmut Prendinger;Mitsuru Ishizuka
Affiliations:
University of Tokyo, Tokyo, Japan 113-8656;Trinity College Dublin, Dublin, Ireland;Trinity College Dublin, Dublin, Ireland;National Institute of Informatics, Tokyo, Japan 101-8430;University of Tokyo, Tokyo, Japan 113-8656
Venue:
IVA '09 Proceedings of the 9th International Conference on Intelligent Virtual Agents
Year:
2009

Citing 13
Cited 2

The impact of animated interface agents: a review of empirical research

International Journal of Human-Computer Studies
The automated design of believable dialogues for animated presentation teams

Embodied conversational agents
Graph-based generation of referring expressions

Computational Linguistics
From brows to trust: evaluating embodied conversational agents

From brows to trust: evaluating embodied conversational agents
Generating Referring Expressions that Involve Gradable Properties

Computational Linguistics
How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments

Presence: Teleoperators and Virtual Environments
Fully generated scripted dialogue for embodied agents

Artificial Intelligence
Automatic Generation of Conversational Behavior for Multiple Embodied Virtual Characters: The Rules and Models behind Our System

IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
MPML3D: agent authoring language for virtual worlds

ACE '08 Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology
Generating monologue and dialogue to present personalised medical information to patients

ENLG '07 Proceedings of the Eleventh European Workshop on Natural Language Generation
Report on the first NLG Challenge on Generating Instructions in Virtual Environments (GIVE)

ENLG '09 Proceedings of the 12th European Workshop on Natural Language Generation
Learning content selection rules for generating object descriptions in dialogue

Journal of Artificial Intelligence Research
Coping with temporal constraints in multimedia presentation planning

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1

A cross-linguistic study on the production of multimodal referring expressions in dialogue

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
Cross-cultural assessment of automatically generated multimodal referring expressions in a virtual world

International Journal of Human-Computer Studies

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.