Evaluating centering-based metrics of coherence for text structuring using a reliably annotated corpus

  • Authors:
  • Nikiforos Karamanis;Massimo Poesio;Chris Mellish;Jon Oberlander

  • Affiliations:
  • University of Edinburgh, UK;University of Essex, UK;University of Aberdeen, UK;University of Edinburgh, UK

  • Venue:
  • ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

We use a reliably annotated corpus to compare metrics of coherence based on Centering Theory with respect to their potential usefulness for text structuring in natural language generation. Previous corpus-based evaluations of the coherence of text according to Centering did not compare the coherence of the chosen text structure with that of the possible alternatives. A corpus-based methodology is presented which distinguishes between Centering-based metrics taking these alternatives into account, and represents therefore a more appropriate way to evaluate Centering from a text structuring perspective.