Automatic Evaluation of Information Ordering: Kendall's Tau
Computational Linguistics
TSCAN: a novel method for topic summarization and content anatomy
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Measuring importance and query relevance in topic-focused multi-document summarization
ACL '07 Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions
Sentence position revisited: a robust light-weight update summarization 'baseline' algorithm
CLIAWS3 '09 Proceedings of the Third International Workshop on Cross Lingual Information Access: Addressing the Information Need of Multilingual Societies
Automatic single-document key fact extraction from newswire articles
EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics
Using signals of human interest to enhance single-document summarization
AAAI'08 Proceedings of the 23rd national conference on Artificial intelligence - Volume 3
INLG '06 Proceedings of the Fourth International Natural Language Generation Conference
Fuzzy swarm diversity hybrid model for text summarization
Information Processing and Management: an International Journal
Formal and functional assessment of the pyramid method for summary content evaluation*
Natural Language Engineering
Automatic generation of story highlights
ACL '10 Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics
A case study of linked enterprise data
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part II
A study on position information in document summarization
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Web-Based Verification on the Representativeness of Terms Extracted from Single Short Documents
WI-IAT '11 Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 03
Text summarisation in progress: a literature review
Artificial Intelligence Review
Integer linear programming for dutch sentence compression
CICLing'10 Proceedings of the 11th international conference on Computational Linguistics and Intelligent Text Processing
Combining syntax and semantics for automatic extractive single-document summarization
CICLing'12 Proceedings of the 13th international conference on Computational Linguistics and Intelligent Text Processing - Volume Part II
An assessment of the accuracy of automatic evaluation in summarization
Proceedings of Workshop on Evaluation Metrics and System Comparison for Automatic Summarization
Topic-based Amharic text summarization with probabilistic latent semantic analysis
Proceedings of the International Conference on Management of Emergent Digital EcoSystems
Hi-index | 0.00 |
Since 2001, the Document Understanding Conferences have been the forum for researchers in automatic text summarization to compare methods and results on common test sets. Over the years, several types of summarization tasks have been addressed--single document summarization, multi-document summarization, summarization focused by question, and headline generation. This paper is an overview of the achieved results in the different types of summarization tasks. We compare both the broader classes of baselines, systems and humans, as well as individual pairs of summarizers (both human and automatic). An analysis of variance model is fitted, with summarizer and input set as independent variables, and the coverage score as the dependent variable, and simulation-based multiple comparisons were performed. The results document the progress in the field as a whole, rather then focusing on a single system, and thus can serve as a future reference on the work done up to date, as well as a starting point in the formulation of future tasks. Results also indicate that most progress in the field has been achieved in generic multi-document summarization and that the most challenging task is that of producing a focused summary in answer to a question/topic.