Enhancing n-gram-based summary evaluation using information content and a taxonomy

Authors:
Mijail Kabadjov;Josef Steinberger;Ralf Steinberger;Massimo Poesio;Bruno Pouliquen
Affiliations:
Joint Research Centre, European Commission, Ispra, (VA), Italy;Joint Research Centre, European Commission, Ispra, (VA), Italy;Joint Research Centre, European Commission, Ispra, (VA), Italy;University of Essex, Colchester, United Kingdom;Joint Research Centre, European Commission, Ispra, (VA), Italy
Venue:
ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
Year:
2010

Citing 2
Cited 0

Automatic evaluation of summaries using N-gram co-occurrence statistics

NAACL '03 Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology - Volume 1
Using information content to evaluate semantic similarity in a taxonomy

IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 1

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we propose a novel information-theoretic metric for automatic summary evaluation when model summaries are available as in the setting of the AESOP task of the Update Summarization track of the Text Analysis Conference (TAC). The metric is based on the concept of information content operationalized by using a taxonomy. Hereby, we present and discuss the results obtained at TAC 2009.