Evaluation of a sentence ranker for text summarization based on Roget's thesaurus

Authors:
Alistair Kennedy;Stan Szpakowicz
Affiliations:
School of Information Technology and Engineering, University of Ottawa, Ottawa, Ontario, Canada;School of Information Technology and Engineering, University of Ottawa, Ottawa, Ontario, Canada and Institute of Computer Science, Polish Academy of Sciences, Warsaw, Poland
Venue:
TSD'10 Proceedings of the 13th international conference on Text, speech and dialogue
Year:
2010

Citing 9
Cited 1

The use of MMR, diversity-based reranking for reordering documents and producing summaries

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Identifying topics by position

ANLC '97 Proceedings of the fifth conference on Applied natural language processing
Centroid-based summarization of multiple documents

Information Processing and Management: an International Journal
The Pyramid Method: Incorporating human content selection variation in summarization evaluation

ACM Transactions on Speech and Language Processing (TSLP)
Support vector machines for query-focused summarization trained and evaluated on pyramid data

ACL '07 Proceedings of the 45th Annual Meeting of the ACL on Interactive Poster and Demonstration Sessions
Sentence position revisited: a robust light-weight update summarization 'baseline' algorithm

CLIAWS3 '09 Proceedings of the Third International Workshop on Cross Lingual Information Access: Addressing the Information Need of Multilingual Societies
A study of two graph algorithms in topic-driven summarization

TextGraphs-1 Proceedings of the First Workshop on Graph Based Methods for Natural Language Processing
Query-focused summaries or query-biased summaries?

ACLShort '09 Proceedings of the ACL-IJCNLP 2009 Conference Short Papers
Not as easy as it seems: automating the construction of lexical chains using Roget's thesaurus

AI'03 Proceedings of the 16th Canadian society for computational studies of intelligence conference on Advances in artificial intelligence

Getting emotional about news summarization

Canadian AI'12 Proceedings of the 25th Canadian conference on Advances in Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

Evaluation is one of the hardest tasks in automatic text summarization. It is perhaps even harder to determine how much a particular component of a summarization system contributes to the success of the whole system. We examine how to evaluate the sentence ranking component using a corpus which has been partially labelled with Summary Content Units. To demonstrate this technique, we apply it to the evaluation of a new sentence-ranking system which uses Roget's Thesaurus. This corpus provides a quick and nearly automatic method of evaluating the quality of sentence ranking.