A model-theoretic coreference scoring scheme
MUC6 '95 Proceedings of the 6th conference on Message understanding
Evaluation metrics for generation
INLG '00 Proceedings of the first international conference on Natural language generation - Volume 14
Using semantic relations to improve information retrieval
Using semantic relations to improve information retrieval
On coreference resolution performance metrics
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Two uses of anaphora resolution in summarization
Information Processing and Management: an International Journal
Generation of repeated references to discourse entities
ENLG '07 Proceedings of the Eleventh European Workshop on Natural Language Generation
Referring expression generation through attribute-based heuristics
ENLG '09 Proceedings of the 12th European Workshop on Natural Language Generation
UCNLG+Sum '09 Proceedings of the 2009 Workshop on Language Generation and Summarisation
Attribute-centric referring expression generation
Empirical methods in natural language generation
Computational generation of referring expressions: A survey
Computational Linguistics
Collaboratively built semi-structured content and Artificial Intelligence: The story so far
Artificial Intelligence
What is being measured in an information graphic?
CICLing'13 Proceedings of the 14th international conference on Computational Linguistics and Intelligent Text Processing - Volume Part I
| Hi-index | 0.00 |
The GREC Task at REG '08 required participating systems to select coreference chains to the main subject of short encyclopaedic texts collected from Wikipedia. Three teams submitted a total of 6 systems, and we additionally created four baseline systems. Systems were tested automatically using a range of existing intrinsic metrics. We also evaluated systems extrinsically by applying coreference resolution tools to the outputs and measuring the success of the tools. In addition, systems were tested in a reading/comprehension experiment involving human subjects. This report describes the GREC Task and the evaluation methods, gives brief descriptions of the participating systems, and presents the evaluation results.