Why it's worth the hassle: the value of in-situ studies when designing Ubicomp

  • Authors:

  • Yvonne Rogers;Kay Connelly;Lenore Tedesco;William Hazlewood;Andrew Kurtz;Robert E. Hall;Josh Hursey;Tammy Toscos

  • Affiliations:

  • The Open University, Computing Department, Milton Keynes, UK and Indiana University, School of Informatics, Bloomington, IN;Indiana University, School of Informatics, Bloomington, IN;Indiana University-Purdue University, Indianapolis, Center for Earth & Environmental Science, Indiana;Indiana University, School of Informatics, Bloomington, IN;Indiana University, School of Informatics, Bloomington, IN;Indiana University-Purdue University, Indianapolis, Center for Earth & Environmental Science, Indiana;Indiana University, School of Informatics, Bloomington, IN;Indiana University, School of Informatics, Bloomington, IN

  • Venue:
  • UbiComp '07 Proceedings of the 9th international conference on Ubiquitous computing
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

How should Ubicomp technologies be evaluated? While lab studies are good at sensing aspects of human behavior and revealing usability problems, they are poor at capturing context of use. In-situ studies are good at demonstrating how people appropriate technologies in their intended setting, but are expensive and difficult to conduct. Here, we show how they can be used more productively in the design process. A mobile learning device was developed to support teams of students carrying out scientific inquiry in the field. An initial in-situ study showed it was not used in the way envisioned. A contextualized analysis led to a comprehensive understanding of the user experience, usability and context of use, leading to a substantial redesign. A second in-situ study showed a big improvement in device usability and collaborative learning. We discuss the findings and conclude how in-situ studies can play an important role in the design and evaluation of Ubicomp applications and user experiences.