Evaluating Mobile Usability: The Role of Fidelity in Full-Scale Laboratory Simulations with Mobile ICT for Hospitals

  • Authors:
  • Yngve Dahl;Ole Andreas Alsos;Dag Svanæs

  • Affiliations:
  • Telenor Research & Innovation, Trondheim, Norway 7004;Department of Computer and Information Science, Norwegian University of Science and Technology, Trondheim, Norway 7491;Department of Computer and Information Science, Norwegian University of Science and Technology, Trondheim, Norway 7491

  • Venue:
  • Proceedings of the 13th International Conference on Human-Computer Interaction. Part I: New Trends
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We have applied full-scale simulations to evaluate the usability of mobile ICT for hospitals in a realistic but controllable research setting. Designing cost-effective and targeted simulations for such a purpose raises the issue of simulation fidelity. Evaluators need to identify which aspects of the research setting that should appear realistic to simulation participants, and which aspect that can be removed or represented more abstractly. Drawing on research on training simulations, this paper discusses three interrelated fidelity components--equipment/prototype fidelity, environmental fidelity, and psychological fidelity. These components need to be adjusted according to which design aspects evaluators want to gather feedback on. We present examples of how we have configured the components in various simulation-based usability assessments of mobile ICT for hospitals. The paper concludes by providing a set of guiding principles concerning the role of fidelity in simulation-based usability evaluations.