GENEVAL: a proposal for shared-task evaluation in NLG

  • Authors:
  • Ehud Reiter;Anja Belz

  • Affiliations:
  • University of Aberdeen, UK;University of Brighton, UK

  • Venue:
  • INLG '06 Proceedings of the Fourth International Natural Language Generation Conference
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose to organise a series of sharedtask NLG events, where participants are asked to build systems with similar input/output functionalities, and these systems are evaluated with a range of different evaluation techniques. The main purpose of these events is to allow us to compare different evaluation techniques, by correlating the results of different evaluations on the systems entered in the events.