Situated evaluation for cooperative systems

  • Authors:
  • Michael Twidale;David Randall;Richard Bentley

  • Affiliations:
  • Computing Department, Lancaster University, Lancaster LA1 4YR UK;Department of Interdisciplinary Studies, Manchester Metropolitan University, Manchester M15 6BG, UK;GMD FIT, Schloss Birlinghoven, 53754 Sankt Augustin, Germany

  • Venue:
  • CSCW '94 Proceedings of the 1994 ACM conference on Computer supported cooperative work
  • Year:
  • 1994

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper discusses an evaluation of the MEAD prototype, a multi-user interface generator tool particularly for use in the context of Air Traffic Control (ATC). The procedures we adopted took the form of opportunistic and informal evaluation sessions with small user groups, including Air Traffic Controllers (ATCOs). We argue that informal procedures are a powerful and cost effective method for dealing with specific evaluation issues in the context of CSCW but that wider issues are more problematic. Most notably, identifying the “validity” or otherwise of CSCW systems requires that the context of use be taken seriously, necessitating a fundamental re-appraisal of the concept of evaluation.