Evaluation of a system for personalized summarization of web contents

  • Authors:
  • Alberto Díaz;Pablo Gervás;Antonio García

  • Affiliations:
  • CES Felipe II, Universidad Complutense de Madrid;SIP, Universidad Complutense de Madrid;Departamento de Comunicación, Universidad Rey Juan Carlos

  • Venue:
  • UM'05 Proceedings of the 10th international conference on User Modeling
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Existing Web personalized information systems typically send to the users the title and the first lines of the chosen items, and links to the full text. This is, in most cases, insufficient for a user to detect if the item is relevant or not. An interesting approach is to replace the first sentences by a personalized summary extracted according to a user profile that represents the information needs of the user. On the other side, it is crucial to measure how much information is lost during the summarization process, and how this information loss may affect the ability of the user to judge the relevance of a given document. The system-oriented evaluation developed in this paper indicates that personalized summaries perform better than generic summaries in terms of identifying documents that satisfy user preferences. We also considered a user-centred qualitative evaluation indicating a high level of user satisfaction with the summarization method described, in consonance with the quantitative results.