A survey of usability evaluation in virtual environments: classification and comparison of methods

  • Authors:

  • Doug A. Bowman;Joseph L. Gabbard;Deborah Hix

  • Affiliations:

  • Department of Computer Science, Virginia Tech;Systems Research Center, Virginia Tech;Systems Research Center, Virginia Tech

  • Venue:
  • Presence: Teleoperators and Virtual Environments - Virtual environments: Virtual environments and mobile robots: Control, simulation, and robot pilot training
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

Virtual environments (VEs) are a relatively new type of human-computer interface in which users perceive and act in a three-dimensional world. The designers of such systems cannot rely solely on design guidelines for traditional two-dimensional interfaces, so usability evaluation is crucial for VEs. This paper presents an overview of VE usability evaluation to organize and critically analyze diverse work from this field. First, we discuss some of the issues that differentiate VE usability evaluation from evaluation of traditional user interfaces such as GUIs. We also present a review of some VE evaluation methods currently in use, and discuss a simple classification space for VE usability evaluation methods. This classification space provides a structured means for comparing evaluation methods according to three key characteristics: involvement of representative users, context of evaluation, and types of results produced. Finally, to illustrate these concepts, we compare two existing evaluation approaches: testbed evaluation (Bowman, Johnson, & Hodges, 1999) and sequential evaluation (Gabbard, Hix, & Swan, 1999).