Evaluation of challenges in human subject studies "in-the-wild" using subjects' personal smartphones

Authors:
Mattia Gustarini;Selim Ickin;Katarzyna Wac
Affiliations:
University of Geneva, Carouge, Switzerland;Blekinge Institute of Technology, Karlskrona, Sweden;University of Geneva, Carouge, Switzerland
Venue:
Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
Year:
2013

Citing 6
Cited 1

Human-Computer Interaction (3rd Edition)

Human-Computer Interaction (3rd Edition)
Getting closer: an empirical investigation of the proximity of user to their smart phones

Proceedings of the 13th international conference on Ubiquitous computing
Indirect content privacy surveys: measuring privacy without asking about it

Proceedings of the Seventh Symposium on Usable Privacy and Security
An overview of quality of experience measurement challenges for video applications in IP networks

WWIC'10 Proceedings of the 8th international conference on Wired/Wireless Internet Communications
Farther than you may think: an empirical investigation of the proximity of users to their mobile phones

UbiComp'06 Proceedings of the 8th international conference on Ubiquitous Computing
Lessons Learned from Large-Scale User Studies: Using Android Market as a Source of Data

International Journal of Mobile Human Computer Interaction

Ubiquitous mobile instrumentation

Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication

Quantified Score

Hi-index	0.00

Visualization

Abstract

The experimental setting of Human Mobile Computer Interaction (HCI) studies is moving from the controlled laboratory to the user's daily-life environments, while employing the users' own smartphones. These studies are challenging for both new and expert researchers in human subject studies in the HCI field. Within the last three years, we conducted three different smartphone-based user studies. From these studies, we have derived key challenges that we successfully overcame during their execution. In this paper, we present the outcomes and explain the adopted solutions for the challenges identified in the design, development and execution, and data analysis phases during the user studies. Our goal is to give newcomers and junior researchers a practical view on our conducted studies, and help practitioners to reflect on their own studies and possibly apply the proposed solutions.