Supporting cognitive walkthrough with video data: a mobile learning evaluation study

Authors:
Silvia Gabrielli;Valeria Mirabella;Stephen Kimani;Tiziana Catarci
Affiliations:
University of Rome "La Sapienza", Rome, Italy;University of Rome "La Sapienza", Rome, Italy;University of Rome "La Sapienza", Rome, Italy;University of Rome "La Sapienza", Rome, Italy
Venue:
Proceedings of the 7th international conference on Human computer interaction with mobile devices & services
Year:
2005

Citing 8
Cited 0

Plans and situated actions: the problem of human-machine communication

Plans and situated actions: the problem of human-machine communication
Heuristic evaluation

Usability inspection methods
The cognitive walkthrough method: a practitioner's guide

Usability inspection methods
Using the cognitive walkthrough for operating procedures

interactions
The streamlined cognitive walkthrough method, working around social constraints encountered in a software development company

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Charting past, present, and future research in ubiquitous computing

ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction in the new millennium, Part 1
Video artifacts for design: bridging the Gap between abstraction and detail

DIS '00 Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques
Inspection-based evaluations

The human-computer interaction handbook

Quantified Score

Hi-index	0.00

Visualization

Abstract

Although expert-based evaluation techniques such as heuristic evaluation and cognitive walkthrough are often inexpensive and quick to apply, they have not proved to be effective in capturing contextual factors that arise in real-world settings. It is no trivial issue to understand how such evaluation techniques could be modified or differently applied so as to better take into account context, without loosing the advantages inherent in those techniques. This paper explores a possible way of addressing the trade-off between application of cognitive walkthrough and low cost improvements of its contextual validity. In particular, we propose and investigate the benefits of supporting cognitive walkthrough with video data about user interaction with an eLearning course on mobile device. Initial results from this study indicated that video data provided evaluators with a more detailed understanding of user characteristics and interaction contexts, leading to an improvement of their assessments in terms of the total number of system's flaws detected. Video data was regarded by experts as both relevant and useful, especially for tuning the evaluation focus on types of difficulties they would normally not have experienced because of differences in terms of abilities, knowledge and background with those of the target user group.