Computational GOMS modeling of a complex team task: lessons learned

Authors:
David E. Kieras;Thomas P. Santoro
Affiliations:
University of Michigan, Ann Arbor, MI;Naval Submarine Medical Research Laboratory, Groton, CT
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2004

Citing 8
Cited 7

A validation of the GOMS model methodology in the development of a specialized, commercial software application

CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
GLEAN: a computer-based tool for rapid GOMS model usability evaluation of user interface designs

Proceedings of the 8th annual ACM symposium on User interface and software technology
Using GOMS for user interface design and evaluation: which technique?

ACM Transactions on Computer-Human Interaction (TOCHI)
The GOMS family of user interface analysis techniques: comparison and contrast

ACM Transactions on Computer-Human Interaction (TOCHI)
The Psychology of Human-Computer Interaction

The Psychology of Human-Computer Interaction
Cognitive architecture

The human-computer interaction handbook
Model-based evaluation

The human-computer interaction handbook
An overview of the EPIC architecture for cognition and performance with application to human-computer interaction

Human-Computer Interaction

Adapting GOMS to model human-robot interaction

Proceedings of the ACM/IEEE international conference on Human-robot interaction
Back stage on the front lines: perspectives and performance in the combat information center

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A technique for evaluating shared workspaces efficiency

CSCWD'06 Proceedings of the 10th international conference on Computer supported cooperative work in design III
Models of Collaboration as the Foundation for Collaboration Technologies

Journal of Management Information Systems
Structuring dimensions for collaborative systems evaluation

ACM Computing Surveys (CSUR)
Analytic evaluation of groupware design

CSCWD'05 Proceedings of the 9th international conference on Computer Supported Cooperative Work in Design II
Analyzing shared workspaces design with human-performance models

CRIWG'06 Proceedings of the 12th international conference on Groupware: design, implementation, and use

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper presents the lessons learned when a computational GOMS modeling tool was used to evaluate user interface concepts and team structure designs for a new class of military shipboard workstations. The lessons are both encouraging and cautionary: For example, computational GOMS models scaled well to a large and complex task involving teams of users. Interruptability and working memory constructs had to be added to conventional GOMS model concepts. However, two surprises emerged: First, the non-psychological aspects of the model construction were the practical bottleneck. Second, user testing data in this domain were difficult to collect and lacked definition, meaning that the model provided a better characterization of the design details than the user testing data. Included in these lessons are recommendations for future model applications and modeling methodology development.