Interactive usability instrumentation

Authors:
Scott Bateman;Carl Gutwin;Nathaniel Osgood;Gordon McCalla
Affiliations:
University of Saskatchewan, Saskatoon, SK, Canada;University of Saskatchewan, Saskatoon, SK, Canada;University of Saskatchewan, Saskatoon, SK, Canada;University of Saskatchewan, Saskatoon, SK, Canada
Venue:
Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
Year:
2009

Citing 9
Cited 4

Studying long-term system use

Communications of the ACM
An approach to large-scale collection of application usage data over the Internet

Proceedings of the 20th international conference on Software engineering
Extracting usability information from user interface events

ACM Computing Surveys (CSUR)
The state of the art in automating usability evaluation of user interfaces

ACM Computing Surveys (CSUR)
Human-Computer Interaction

Human-Computer Interaction
Large-scale collection of application usage data and user feedback to inform interactive software development

Large-scale collection of application usage data and user feedback to inform interactive software development
Exploratory sequential data analysis: foundations

Human-Computer Interaction
Traces using aspect oriented programming and interactive agent-based architecture for early usability evaluation: basic principles and comparison

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability
Logging events crossing architectural boundaries

INTERACT'05 Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction

MoPeDT: features and evaluation of a user-centred prototyping tool

Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
Distributed usability evaluation: enabling large-scale usability evaluation with user-controlled instrumentation

Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Um estudo experimental de avaliação da experiência dos usuários de aplicativos móveis a partir da captura automática dos dados contextuais e de interação

Proceedings of the 11th Brazilian Symposium on Human Factors in Computing Systems
Smartphone applications usability evaluation: a hybrid model and its implementation

HCSE'12 Proceedings of the 4th international conference on Human-Centered Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

Usage data logged from user interactions can be extremely valuable for evaluating software usability. However, instrumenting software to collect usage data is a time-intensive task that often requires technical expertise as well as an understanding of the usability issues to be explored. We have developed a new technique for software instrumentation that removes the need for programming. Interactive Usability Instrumentation (IUI) allows usability evaluators to work directly with a system's interface to specify what components and what events should be logged. Evaluators are able to create higher-level abstractions on the events they log and are provided with real-time feedback on how events are logged. As a proof of the IUI concept, we have created the UMARA system, an instrumentation system that is enabled by recent advances in aspect-oriented programming. UMARA allows users to instrument software without the need for additional coding, and provides tools for specification, data collection, and data analysis. We report on the use of UMARA in the instrumentation of two large open-source projects; our experiences show that IUI can substantially simplify the process of log-based usability evaluation.