Estimating the relative usability of two interfaces: heuristic, formal, and empirical methods compared

  • Authors:
  • Jakob Nielsen;Victoria L. Phillips

  • Affiliations:
  • Bellcore, 445 South Street, Morristown, NJ;Carnegie Mellon University, Pittsburgh, PA and Bellcore, 445 South Street, Morristown, NJ

  • Venue:
  • CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
  • Year:
  • 1993

Quantified Score

Hi-index 0.00

Visualization

Abstract

Two alternative user interface designs were subjected to user testing to measure user performance in a database query task. User performance was also estimated heuristically in three different ways and by use of formal GOMS modelling. The estimated values for absolute user performance had very high variability, but estimates of the relative advantage of the fastest interface were less variable. Choosing the fastest of the two designs would have a net present value more than 1,000 times the cost of getting the estimates. A software manager would make the correct choice every time in our case study if decisions were based on at least three independent estimates. User testing was 4.9 times as expensive as the cheapest heuristic method but provided better performance estimates.