Text specificity and impact on quality of news summaries

  • Authors:
  • Annie Louis;Ani Nenkova

  • Affiliations:
  • University of Pennsylvania, Philadelphia, PA;University of Pennsylvania, Philadelphia, PA

  • Venue:
  • MTTG '11 Proceedings of the Workshop on Monolingual Text-To-Text Generation
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In our work we use an existing classifier to quantify and analyze the level of specific and general content in news documents and their human and automatic summaries. We discover that while human abstracts contain a more balanced mix of general and specific content, automatic summaries are overwhelmingly specific. We also provide an analysis of summary specificity and the summary quality scores assigned by people. We find that too much specificity could adversely affect the quality of content in the summary. Our findings give strong evidence for the need for a new task in abstractive summarization: identification and generation of general sentences.