Some measures and procedures for evaluation of the user interface in an information retrieval system

  • Authors:
  • J. Tague;R. Schultz

  • Affiliations:
  • School of Library and Information Science, University of Western Ontario, London, Ontario, Canada N6G 1H1;School of Library and Information Science, University of Western Ontario, London, Ontario, Canada N6G 1H1

  • Venue:
  • SIGIR '88 Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 1988

Quantified Score

Hi-index 0.00

Visualization

Abstract

Planning the evaluation of an information retrieval system involves two steps: first, a determination of performance descriptors and measures appropriate to the system objectives and, secondly, a development of an evaluation design which ensures the effect of variation in components of interest will be isolated and assessed in an unbiased fashion. This paper examines the question of retrieval system evaluation from the perspective of the user. It presents evaluation procedures which are appropriate to this perspective and which can be used to isolate the effect of variation in the user interface to the system. The general procedure is exemplified by an application to evaluation of an experimental OPAC interface.