Topic segmentation algorithms for text summarization and passage retrieval: an exhaustive evaluation

  • Authors:
  • Gaël Dias;Elsa Alves;José Gabriel Pereira Lopes

  • Affiliations:
  • HULTIG, University of Beira Interior, Covilhã, Portugal;HULTIG, University of Beira Interior, Covilhã, Portugal and GLINT, New University of Lisbon, Lisbon, Portugal;GLINT, New University of Lisbon, Lisbon, Portugal

  • Venue:
  • AAAI'07 Proceedings of the 22nd national conference on Artificial intelligence - Volume 2
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In order to solve problems of reliability of systems based on lexical repetition and problems of adaptability of language-dependent systems, we present a context-based topic segmentation system based on a new informative similarity measure based on word co-occurrence. In particular, our evaluation with the state-of-the-art in the domain i.e. the c99 and the TextTiling algorithms shows improved results both with and without the identification of multiword units.