On the subjectivity of human-authored summaries*

  • Authors:
  • Balakrishna Kolluru;Yoshihiko Gotoh

  • Affiliations:
  • Department of computer science, university of sheffield, sheffield s1 4dp, united kingdom e-mail: b.kolluru@dcs.shef.ac.uk, y.gotoh@dcs.shef.ac.uk;Department of computer science, university of sheffield, sheffield s1 4dp, united kingdom e-mail: b.kolluru@dcs.shef.ac.uk, y.gotoh@dcs.shef.ac.uk

  • Venue:
  • Natural Language Engineering
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Human-generated summaries are a blend of content and style, bound by the task restrictions, but are ‘subject to subjectiveness’ of the individuals summarising the documents. We study the impact of various facets that cause subjectivity such as brevity, information content and information coverage on human-authored summaries. The scale of subjectivity is quantitatively measured among various summaries using a question–answer-based cross-comprehension test. The test evaluates summaries for meaning rather than exact words based on questions, framed by the summary authors, derived from the summary. The number of questions that cannot be answered after reading the candidate summary reflects its subjectivity. The qualitative analysis of the outcome of the cross-comprehension test shows the relationship between the length of a summary, information content and nature of questions framed by the summary author.