Report on the second second challenge on generating instructions in virtual environments (GIVE-2.5)

Authors:
Kristina Striegnitz;Alexandre Denis;Andrew Gargett;Konstantina Garoufi;Alexander Koller;Mariët Theune
Affiliations:
Union College;LORIA/CNRS;U.A.E. University;University of Potsdam;University of Potsdam;University of Twente
Venue:
ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
Year:
2011

Citing 11
Cited 5

The software architecture for the first challenge on generating instructions in virtual environments

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics: Demonstrations Session
Report on the second NLG challenge on generating instructions in virtual environments (GIVE-2)

INLG '10 Proceedings of the 6th International Natural Language Generation Conference
The first challenge on generating instructions in virtual environments

Empirical methods in natural language generation
The GRUVE challenge: generating routes under uncertainty in virtual environments

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
Direction giving: an attempt to increase user engagement

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
The Bremen system for the GIVE-2.5 challenge

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
The GIVE-2.5 C generation system

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
CL system: giving instructions by corpus based selection

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
The Loria instruction generation system L in GIVE 2.5

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
The Potsdam NLG systems at the GIVE-2.5 challenge

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
The Thumbs Up!: Twente system for GIVE 2.5

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation

Combining symbolic and corpus-based approaches for the generation of successful referring expressions

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
The Potsdam NLG systems at the GIVE-2.5 challenge

ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
Referring in installments: a corpus study of spoken object references in an interactive virtual environment

INLG '12 Proceedings of the Seventh International Natural Language Generation Conference
Enhancing referential success by tracking hearer gaze

SIGDIAL '12 Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue
A task-performance evaluation of referring expressions in situated collaborative task dialogues

Language Resources and Evaluation

Quantified Score

Hi-index	0.00

Visualization

Abstract

GIVE-2.5 evaluates eight natural language generation (NLG) systems that guide human users through solving a task in a virtual environment. The data is collected via the Internet, and to date, 536 interactions of subjects with one of the NLG systems have been recorded. The systems are compared using both task performance measures and subjective ratings by human users.