Of course I wouldn't do that in real life: advancing the arguments for increasing realism in HCI experiments

Authors:
Letitia Lew;Truc Nguyen;Solomon Messing;Sean Westwood
Affiliations:
Stanford University, Stanford, CA, USA;Stanford University, Stanford, CA, USA;Stanford University, Stanford, CA, USA;Stanford University, Stanford, CA, USA
Venue:
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Year:
2011

Citing 4
Cited 1

You've been warned: an empirical study of the effectiveness of web browser phishing warnings

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Making sense of strangers' expertise from signals in digital artifacts

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
It's not that important: demoting personal information of low subjective importance using GrayArea

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Developing a low-cost driving simulator for the evaluation of in-vehicle technologies

Proceedings of the 1st International Conference on Automotive User Interfaces and Interactive Vehicular Applications

Embedding technology in the classroom: the train the teacher model

Proceedings of the 11th International Conference on Interaction Design and Children

Quantified Score

Hi-index	0.00

Visualization

Abstract

We offer a nuanced examination of the way that realism can impact internal and external validity in HCI experiments. We show that if an HCI experiment lacks realism across any of four dimensions--appearance, content, task and setting--the lack of realism can confound the study by interacting with the treatment and weakening internal or external validity. We argue furthermore, that realism can be increased while still maintaining control: analogue experiments allow researchers to conduct experiments in more ecologically valid environments and online experiments bridge the gap between the cleanroom and field. While increasing the level of realism in an experiment can introduce noise, technological developments have made it easier to collect rich analytics on behavior and usage.