Formative design evaluation of superbook

  • Authors:

  • Dennis E. Egan;Joel R. Remde;Louis M. Gomez;Thomas K. Landauer;Jennifer Eberhardt;Carol C. Lochbaum

  • Affiliations:

  • Bellcore, Morristown, NJ;Bellcore, Morristown, NJ;Bellcore, Morristown, NJ;Bellcore, Morristown, NJ;Bellcore, Morristown, NJ;Bellcore, Morristown, NJ

  • Venue:
  • ACM Transactions on Information Systems (TOIS)
  • Year:
  • 1989

Quantified Score

Hi-index 0.03

Visualization

Abstract

SuperBook is a hypertext browsing system designed to improve the usability of conventional documents. Successive versions of SuperBook were evaluated in a series of behavioral studies. Students searched for information in a statistics text. presented either in conventional printed form or in SuperBook form. The best version of SuperBook enabled students to answer search questions more quickly and accurately than they could with the conventional text. Students wrote higher quality “open-book” essays using SuperBook than they did with the conventional text, and their subjective ratings of the documentation strongly favored SuperBook.This work is a case study of formative design-evaluation. Behavioral evaluation of the first version of SuperBook showed how design factors and user strategies affected search and established baseline performance measures with printed text. The second version of SuperBook was implemented with the goal of improving search accuracy and speed. User strategies that had proved effective in the first study were made very easy and attractive to use. System response time for common operations was greatly improved. Behavioral evaluation of the new SuperBook demonstrated its superiority to printed text and suggested additional improvements that were incorporated into “MiteyBook,” a SuperBook implementation for PC-size screens. Search with MiteyBook proved to be approximately 25 percent faster and 25 percent more accurate than that obtained with a conventional printed book.