Evaluating system utility and conceptual fit using CASSM

Authors:
Ann Blandford;Thomas R. G. Green;Dominic Furniss;Stephann Makri
Affiliations:
UCLIC, University College London, Remax House, 31-32 Alfred Place, London WC1E 7DP, UK;University of Leeds, UK;UCLIC, University College London, Remax House, 31-32 Alfred Place, London WC1E 7DP, UK;UCLIC, University College London, Remax House, 31-32 Alfred Place, London WC1E 7DP, UK
Venue:
International Journal of Human-Computer Studies
Year:
2008

Citing 16
Cited 10

Programmable user models for predictive evaluation of interface designs

CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Cognitive dimensions of notations

Proceedings of the fifth conference of the British Computer Society, Human-Computer Interaction Specialist Group on People and computers V
Getting around the task-artifact cycle: how to make claims and design by scenario

ACM Transactions on Information Systems (TOIS)
Heuristic evaluation

Usability inspection methods
The cognitive walkthrough method: a practitioner's guide

Usability inspection methods
Learning and using the cognitive walkthrough method: a case study approach

CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The skull beneath the skin: entity-relationship models of information artifacts

International Journal of Human-Computer Studies - Special issue: the role of cognitive science in human-computer interaction
Training software engineers in a novel usability evaluation technique

International Journal of Human-Computer Studies
The Psychology of Human-Computer Interaction

The Psychology of Human-Computer Interaction
The cognitive dimension of viscosity: A sticky problem for HCI

INTERACT '90 Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction
Getting into a system: External-internal task mapping analysis

CHI '83 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluating usability methods: why the current literature fails the practitioner

interactions - The digital muse: HCI in support of creativity
Measuring the conceptual fitness of an application in a computing ecosystem

Proceedings of the 2004 ACM workshop on Interdisciplinary software engineering research
What do usability evaluators do in practice?: an explorative study of think-aloud testing

DIS '06 Proceedings of the 6th conference on Designing Interactive systems
Damaged merchandise? a review of experiments that compare usability evaluation methods

Human-Computer Interaction
Formalising an understanding of user-system misfits

EHCI-DSVIS'04 Proceedings of the 2004 international conference on Engineering Human Computer Interaction and Interactive Systems

Using information behaviors to evaluate the functionality and usability of electronic resources: From Ellis's model to evaluation

Journal of the American Society for Information Science and Technology
Improving the Cost Structure of Sensemaking Tasks: Analysing User Concepts to Inform Information System Design

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Bringing users' conceptual models into design: an introduction to CASSM analysis

Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
Evaluating the Information Behaviour methods: Formative evaluations of two methods for assessing the functionality and usability of electronic information resources

International Journal of Human-Computer Studies
Misfits in abstractions: towards user-centered design in domain-specific languages for end-user programming

Proceedings of the ACM international conference companion on Object oriented programming systems languages and applications companion
How can a DSL for expert end-users be designed for better usability?: a case study in computer music

CHI '12 Extended Abstracts on Human Factors in Computing Systems
Modeling and characterizing user interfaces at the electronic visualization laboratory

Proceedings of the 4th Mexican Conference on Human-Computer Interaction
Developing a new computer music programming language in the 'research through design' context

Proceedings of the 3rd annual conference on Systems, programming, and applications: software for humanity
Engineering works: what is (and is not) engineering for interactive computer systems?

Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
Supporting learning within the workplace: device training in healthcare

Proceedings of the 31st European Conference on Cognitive Ergonomics

Quantified Score

Hi-index	0.00

Visualization

Abstract

There is a wealth of user-centred evaluation methods (UEMs) to support the analyst in assessing interactive systems. Many of these support detailed aspects of use-for example: is the feedback helpful? Are labels appropriate? Is the task structure optimal? Few UEMs encourage the analyst to step back and consider how well a system supports users' conceptual understandings and system utility. In this paper, we present CASSM, a method, which focuses on the quality of 'fit' between users and an interactive system. We describe the methodology of conducting a CASSM analysis and illustrate the approach with three contrasting worked examples (a robotic arm, a digital library system and a drawing tool) that demonstrate different depths of analysis. We show how CASSM can help identify re-design possibilities to improve system utility. CASSM complements established evaluation methods by focusing on conceptual structures rather than procedures. Prototype tool support for completing a CASSM analysis is provided by Cassata, an open source development.