It's a jungle out there: practical considerations for evaluation in the city

Authors:
Melanie Kellar;Derek Reilly;Kirstie Hawkey;Malcolm Rodgers;Bonnie MacKay;David Dearman;Vicki Ha;W. Joseph MacInnes;Michael Nunes;Karen Parker;Tara Whalen;Kori M. Inkpen
Affiliations:
Dalhousie University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada;Saint Mary's University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada;Dalhousie University, Halifax, NS Canada
Venue:
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Year:
2005

Citing 6
Cited 11

Methodology matters: doing research in the behavioral and social sciences

Human-computer interaction
“I'll get that off the audio”: a case study of salvaging multimedia meeting records

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
A diary study of rendezvousing: implications for position-aware computing and communications for the general public

GROUP '01 Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work
Everyday Life as a Stage in Creating and Performing Scenarios for Wireless Devices

Personal and Ubiquitous Computing
Experience clip: method for user participation and evaluation of mobile concepts

PDC 04 Proceedings of the eighth conference on Participatory design: Artful integration: interweaving media, materials and practices - Volume 1
Effect of location-awareness on rendezvous behaviour

CHI '05 Extended Abstracts on Human Factors in Computing Systems

Évaluation des dispositifs mobiles: sur le terrain ou en laboratoire ?

IHM '06 Proceedings of the 18th International Conferenceof the Association Francophone d'Interaction Homme-Machine
MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones

Proceedings of the 5th international conference on Mobile systems, applications and services
Scavenger Hunt: An Empirical Method for Mobile Collaborative Problem-Solving

IEEE Pervasive Computing
Techniques for location selection on a mobile device

EATIS '07 Proceedings of the 2007 Euro American conference on Telematics and information systems
Learning Key Contexts of Use in the Wild for Driving Plastic User Interfaces Engineering

HCSE-TAMODIA '08 Proceedings of the 2nd Conference on Human-Centered Software Engineering and 7th International Workshop on Task Models and Diagrams
Toward a best practice for laboratory-based usability evaluations of mobile ICT for hospitals

Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
User experience evaluation in the wild

CHI '09 Extended Abstracts on Human Factors in Computing Systems
Rendezvousing with location-aware devices: Enhancing social coordination

Interacting with Computers
No cure for curiosity: linking physical and digital urban layers

Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Content sharing on public screens: experiences through iterating social and spatial contexts

Proceedings of the 24th Australian Computer-Human Interaction Conference
Evaluating the experiential user experience of public display applications in the wild

Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

An essential aspect of mobile and ubiquitous computing research is evaluation within the expected usage context, including environment. When that environment is an urban center, it can be dynamic, expansive, and unpredictable. Methodologies that focus on genuine use in the environment can uncover valuable insights, although they may also limit measurement and control. In this paper, we present our experiences applying traditional experimental techniques for field research in two separate projects set in urban environments. We argue that although traditional methods may be difficult to apply in cities, the challenges are surmountable, and this kind of field research can be a crucial component of evaluation.