Comparison of empirical testing and walkthrough methods in user interface evaluation
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Constraint satisfaction and debugging for interactive user interfaces
Constraint satisfaction and debugging for interactive user interfaces
Usability testing in the field: bringing the laboratory to the user
CHI '94 Conference Companion on Human Factors in Computing Systems
Human-computer interaction (2nd ed.)
Human-computer interaction (2nd ed.)
Measuring usability: are effectiveness, efficiency, and satisfaction really correlated?
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Charting past, present, and future research in ubiquitous computing
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction in the new millennium, Part 1
Predicting the effects of in-car interfaces on driver behavior using a cognitive architecture
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
On the road and on the Web?: comprehension of synthetic and human speech while driving
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gestural and audio metaphors as a means of control for mobile devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Interactive System Design
Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests
Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests
Overcoming the Lack of Screen Space on Mobile Computers
Personal and Ubiquitous Computing
Location-Aware Shopping Assistance: Evaluation of a Decision-Theoretic Approach
Mobile HCI '02 Proceedings of the 4th International Symposium on Mobile Human-Computer Interaction
Comparative usability evaluation
Behaviour & Information Technology
Damaged merchandise? a review of experiments that compare usability evaluation methods
Human-Computer Interaction
The Design of Everyday Things
A framework for mobile evaluation
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Defining scenarios for mobile design and evaluation
CHI '08 Extended Abstracts on Human Factors in Computing Systems
A mixed-fidelity prototyping tool for mobile devices
AVI '08 Proceedings of the working conference on Advanced visual interfaces
Lessons from early stages design of mobile applications
Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Evaluating the appropriateness of speech input in marine applications: a field evaluation
Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Using mobile preference-based searching to improve tourism decision support
Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology
Toward a best practice for laboratory-based usability evaluations of mobile ICT for hospitals
Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
Designing a vision-based mobile interface for in-store shopping
Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
Let your users do the testing: a comparison of three remote asynchronous usability testing methods
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A comparison of the impact of avoidance cues in hazard avoidance during evaluation of text entry
BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 2
A mobile tool for in-situ prototyping
Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
An Evaluation Framework for Mobile User Interfaces
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Remote evaluation of mobile context-aware systems using data-gathering agents
AIC'09 Proceedings of the 9th WSEAS international conference on Applied informatics and communications
User acceptance of digital tourist guides lessons learnt from two field studies
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability
A closer look at recognition-based graphical passwords on mobile devices
Proceedings of the Sixth Symposium on Usable Privacy and Security
Seeking a theoretical foundation for design of in sitro usability assessments
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Experiments in the wild: public evaluation of off-screen visualizations in the Android market
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Prototyping iPhone apps: realistic experiences on the device
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Proceedings of the 28th ACM International Conference on Design of Communication
Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia
A Meta-Analytical Review of Empirical Mobile Usability Studies
Journal of Usability Studies
Cognitive load and usability analysis of R-MAP for the people who are blind or visual impaired
Proceedings of the 29th ACM international conference on Design of communication
Briefing news reporting with mobile assignments: perceptions, needs and challenges
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
The effect of task assignments and instruction types on remote asynchronous usability testing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
On the use of virtual environments for the evaluation of location-based applications
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Handheld handholding: small-screen support for museum visitors
EVA'11 Proceedings of the 2011 international conference on Electronic Visualisation and the Arts
Proceedings of the 10th Brazilian Symposium on on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction
Designing and Evaluating Mobile Interaction: Challenges and Trends
Foundations and Trends in Human-Computer Interaction
Mobile augmented reality: exploring design and prototyping techniques
MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
A real-world study of an audio-tactile tourist guide
MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
Proceedings of the 13th International Conference on Interacción Persona-Ordenador
Remote and Autonomous Studies of Mobile and Ubiquitous Applications in Real Contexts
International Journal of Mobile Human Computer Interaction
Leaving the wild: lessons from community technology handovers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Beyond heat maps: mining common swipe gestures
Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia
| Hi-index | 0.00 |
The distinction between field and laboratory is classical in research methodology. In human-computer interaction, and in usability evaluation in particular, it has been a controversial topic for several years. The advent of mobile devices has revived this topic. Empirical studies that compare evaluations in the two settings are beginning to appear, but they provide very different results. This paper presents results from an experimental comparison of a field-based and a lab-based usability evaluation of a mobile system. The two evaluations were conducted in exactly the same way. The conclusion is that it is definitely worth the hassle to conduct usability evaluations in the field. In the field-based evaluation we identified significantly more usability problems and this setting revealed problems with interaction style and cognitive load that were not identified in the laboratory.