Evaluation of phrase-representation summarization based on information retrieval task

  • Authors:
  • Mamiko Oka;Yoshihiro Ueda

  • Affiliations:
  • Industry Solutions Company, Fuji Xerox Co., Ltd., Kanagawa, Japan;Industry Solutions Company, Fuji Xerox Co., Ltd., Kanagawa, Japan

  • Venue:
  • NAACL-ANLP-AutoSum '00 Proceedings of the 2000 NAACL-ANLP Workshop on Automatic Summarization
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

We have developed an improved task-based evaluation method of summarization, the accuracy of which is increased by specifying the details of the task including background stories, and by assigning ten subjects per summary sample. The method also serves precision/recall pairs for a variety of situations by introducing multiple levels of relevance assessment. The method is applied to prove phrase-represented summary is most effective to select relevant documents from information retrieval results.