A comprehensive comparative evaluation of RST-based summarization methods

  • Authors:

  • Vinícius Rodrigues Uzêda;Thiago Alexandre Salgueiro Pardo;Maria Das Graças Volpe Nunes

  • Affiliations:

  • Universidade de São Paulo, Brazil;Universidade de São Paulo, Brazil;Universidade de São Paulo, Brazil

  • Venue:
  • ACM Transactions on Speech and Language Processing (TSLP)
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Motivated by governmental, commercial and academic interests, and due to the growing amount of information, mainly online, automatic text summarization area has experienced an increasing number of researches and products, which led to a countless number of summarization methods. In this paper, we present a comprehensive comparative evaluation of the main automatic text summarization methods based on Rhetorical Structure Theory (RST), claimed to be among the best ones. We compare our results to superficial summarizers, which belong to a paradigm with severe limitations, and to hybrid methods, combining RST and superficial methods. We also test voting systems and machine learning techniques trained on RST features. We run experiments for English and Brazilian Portuguese languages and compare the results obtained by using manually and automatically parsed texts. Our results systematically show that all RST methods have comparable overall performance and that they outperform most of the superficial methods. Machine learning techniques achieved high accuracy in the classification of text segments worth of being in the summary, but were not able to produce more informative summaries than the regular RST methods.