BLEU: a method for automatic evaluation of machine translation
ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Evaluating algorithms for the generation of referring expressions using a balanced corpus
ENLG '07 Proceedings of the Eleventh European Workshop on Natural Language Generation
Attribute selection for referring expression generation: new algorithms and evaluation methods
INLG '08 Proceedings of the Fifth International Natural Language Generation Conference
That's nice... what can you do with it?
Computational Linguistics
Referring expression generation through attribute-based heuristics
ENLG '09 Proceedings of the 12th European Workshop on Natural Language Generation
The TUNA-REG Challenge 2009: overview and evaluation results
ENLG '09 Proceedings of the 12th European Workshop on Natural Language Generation
ENLG '09 Proceedings of the 12th European Workshop on Natural Language Generation
Validating the web-based evaluation of NLG systems
ACLShort '09 Proceedings of the ACL-IJCNLP 2009 Conference Short Papers
Extracting parallel fragments from comparable corpora for data-to-text generation
INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Cross-linguistic attribute selection for REG: comparing Dutch and English
INLG '10 Proceedings of the 6th International Natural Language Generation Conference
Attribute-centric referring expression generation
Empirical methods in natural language generation
Introducing shared tasks to NLG: the TUNA shared task evaluation challenges
Empirical methods in natural language generation
Discrete vs. continuous rating scales for language evaluation in NLP
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Does size matter: how much data is required to train a REG algorithm?
HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
Computational generation of referring expressions: A survey
Computational Linguistics
Generating subsequent reference in shared visual scenes: computation vs. re-use
EMNLP '11 Proceedings of the Conference on Empirical Methods in Natural Language Processing
The impact of visual context on the content of referring expressions
ENLG '11 Proceedings of the 13th European Workshop on Natural Language Generation
GRE3D7: a corpus of distinguishing descriptions for objects in visual scenes
UCNLG+EVAL '11 Proceedings of the UCNLG+Eval: Language Generation and Evaluation Workshop
Information Processing and Management: an International Journal
| Hi-index | 0.00 |
The TUNA Challenge was a set of three shared tasks at REG '08, all of which used data from the TUNA Corpus. The three tasks covered attribute selection for referring expressions (TUNA-AS), realisation (TUNA-R) and end-to-end referring expression generation (TUNA-REG). 8 teams submitted a total of 33 systems to the three tasks, with an additional submission to the Open Track. The evaluation used a range of automatically computed measures. In addition, an evaluation experiment was carried out using the peer outputs for the TUNA-REG task. This report describes each task and the evaluation methods used, and presents the evaluation results.