Report on the second NLG challenge on generating instructions in virtual environments (GIVE-2)

  • Authors:
  • Alexander Koller;Kristina Striegnitz;Andrew Gargett;Donna Byron;Justine Cassell;Robert Dale;Johanna Moore;Jon Oberlander

  • Affiliations:
  • Saarland University;Union College;Saarland University;Northeastern University;Northwestern University;Macquarie University;University of Edinburgh;University of Edinburgh

  • Venue:
  • INLG '10 Proceedings of the 6th International Natural Language Generation Conference
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe the second installment of the Challenge on Generating Instructions in Virtual Environments (GIVE-2), a shared task for the NLG community which took place in 2009--10. We evaluated seven NLG systems by connecting them to 1825 users over the Internet, and report the results of this evaluation in terms of objective and subjective measures.