Modeling and evaluating summaries using complex networks

  • Authors:
  • Thiago Alexandre Salgueiro Pardo;Lucas Antiqueira;Maria das Graças Volpe Nunes;Osvaldo N. Oliveira;Luciano da Fontoura Costa

  • Affiliations:
  • Núcleo Interinstitucional de Lingüística Computacional (NILC), CP 668 – ICMC-USP, São Carlos, SP, Brasil;Núcleo Interinstitucional de Lingüística Computacional (NILC), CP 668 – ICMC-USP, São Carlos, SP, Brasil;Núcleo Interinstitucional de Lingüística Computacional (NILC), CP 668 – ICMC-USP, São Carlos, SP, Brasil;Núcleo Interinstitucional de Lingüística Computacional (NILC), CP 668 – ICMC-USP, São Carlos, SP, Brasil;Instituto de Física de São Carlos, CP 369 – IFSC-USP, São Carlos, SP, Brasil

  • Venue:
  • PROPOR'06 Proceedings of the 7th international conference on Computational Processing of the Portuguese Language
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a summary evaluation method based on a complex network measure. We show how to model summaries as complex networks and establish a possible correlation between summary quality and the measure known as dynamics of the network growth. It is a generic and language independent method that enables easy and fast comparative evaluation of summaries. We evaluate our approach using manually produced summaries and automatic summaries produced by three automatic text summarizers for the Brazilian Portuguese language. The results are in agreement with human intuition and showed to be statistically significant.