Advancing the study of programming with computer-aided protocol analysis
Empirical studies of programmers: second workshop
Video: Data for studying human-computer interaction
CHI '88 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
EVA: an experimental video annotator for symbolic analysis of video data
ACM SIGCHI Bulletin
Computer support for transcribing recorded activity
ACM SIGCHI Bulletin
Unified theories of cognition
CSCW '90 Proceedings of the 1990 ACM conference on Computer-supported cooperative work
A case study of using a manual online
Machine-Mediated Learning
Computer analysis of user interfaces based on repetition in transcripts of user sessions
ACM Transactions on Information Systems (TOIS)
Integrated data capture and analysis tools for research and testing on graphical user interfaces
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Designing theory-based systems: a case study
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Automated analysis of computer-generated software usage protocols: an exploratory study
Automated analysis of computer-generated software usage protocols: an exploratory study
A hypertext writing environment and its cognitive basis (panel session)
HYPERTEXT '87 Proceedings of the ACM conference on Hypertext
Transition network grammars for natural language analysis
Communications of the ACM
The Psychology of Human-Computer Interaction
The Psychology of Human-Computer Interaction
Human Problem Solving
Formal Grammar and Human Factors Design of an Interactive Graphics System
IEEE Transactions on Software Engineering
Finding canonical behaviors in user protocols
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
On Computing Canonical Subsets of Graph-Based Behavioral Representations
GbRPR '09 Proceedings of the 7th IAPR-TC-15 International Workshop on Graph-Based Representations in Pattern Recognition
| Hi-index | 0.00 |
Over the past 8 years, The TextLab Research Group within the Department of Computer Science at the University of North Carolina has developed a collection of tools and techniques for recording users' interactions with graphics-based direct manipulation computer systems in machine-readable form and for automatically analyzing and displaying those data. This article describes these tools, discusses their methodological context, and considers their implications for software design and studies of human-computer interaction. Tools discussed include the following: tracking users' behaviors and producing a machine-recorded protocol at the level of users' actions, replaying users' sessions from the protocol data, modeling users' strategies using formal cognitive grammars, analyzing user sessions by parsing them with the grammars, and displaying results in visual form-both static and animated--to facilitate interpretation and understanding by researchers. These tools are placed in a methodological context by reviewing issues associated with concurrent think-aloud, keystroke, X-Windows, and video protocols; other support systems for working with these forms of protocol data are also reviewed. The discussion concludes with our reflections on the methodology and its application to computer systems and research objectives different from our own.