The effect of testing location on usability testing performance, participant stress levels, and subjective testing experience

  • Authors:
  • Chris Andrzejczak;Dahai Liu

  • Affiliations:
  • University of Central Florida, Department of Industrial Engineering and Management Systems, 4000 Central Florida Blvd, Orlando, FL 32816, United States;Embry-Riddle Aeronautical University, Department of Human Factors and Systems, 600 South Clyde Morris Blvd, Daytona Beach, FL 32114, United States

  • Venue:
  • Journal of Systems and Software
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

The effect of testing location on usability test elements such as stress levels and user experience is not clear. A comparison between traditional lab testing and synchronous remote testing was conducted. The present study investigated two groups of users in remote and traditional settings. Within each group participants completed two tasks, a simple task and a complex task. The dependent measures were task time taken, number of critical incidents reported, and user-reported anxiety score. Task times differed significantly between the physical location condition; this difference was not meaningful for real world application, and likely introduced by overhead regarding synchronous remote testing methods. Critical incident reporting counts did not differ in any condition. No significant differences were found in user reported stress levels. Subjective assessments of the study and interface also did not differ significantly. Study findings suggest a similar user testing experience exists for remote and traditional laboratory usability testing.