Remote evaluation: the network as an extension of the usability laboratory
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Remote usability evaluation: can users report their own critical incidents?
CHI 98 Cconference Summary on Human Factors in Computing Systems
In the lab and out in the wild: remote web usability testing for mobile devices
CHI '02 Extended Abstracts on Human Factors in Computing Systems
Methodological Challenges in the Study of Technology Use at Home
HOIT '00 Proceedings of the IFIP TC9 WG9.3 International Conference on Home Oriented Informatics and Telematics,: Information, Technology and Society
HICSS '99 Proceedings of the Thirty-Second Annual Hawaii International Conference on System Sciences-Volume 2 - Volume 2
Remote evaluation for post-deployment usability improvement
AVI '98 Proceedings of the working conference on Advanced visual interfaces
A comparison of synchronous remote and local usability studies for an expert interface
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Instant data analysis: conducting usability evaluations in a day
Proceedings of the third Nordic conference on Human-computer interaction
IV '06 Proceedings of the conference on Information Visualization
It's worth the hassle!: the added value of evaluating the usability of mobile systems in the field
Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
What happened to remote usability testing?: an empirical study of three methods
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usability testing: what have we overlooked?
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A comparative study of two usability evaluation methods using a web-based e-learning application
Proceedings of the 2007 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries
Making use of business goals in usability evaluation: an experiment with novice evaluators
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Handbook of Usability TestingXXX: Howto Plan, Design, and Conduct Effective Tests
Handbook of Usability TestingXXX: Howto Plan, Design, and Conduct Effective Tests
Let your users do the testing: a comparison of three remote asynchronous usability testing methods
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Number of people required for usability evaluation: the 10±2 rule
Communications of the ACM
Remote usability tests: an extension of the usability toolbox for online-shops
UAHCI'07 Proceedings of the 4th international conference on Universal access in human computer interaction: coping with diversity
Work-domain knowledge in usability evaluation: Experiences with Cooperative Usability Testing
Journal of Systems and Software
Extracting usability and user experience information from online user reviews
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
| Hi-index | 0.01 |
Remote asynchronous usability testing involves users directly in reporting usability problems. Most studies of this approach employ predefined tasks to ensure that users experience specific aspects of the system, whereas other studies use no task assignments. Yet the effect of using predefined tasks is still to be uncovered. There is also limited research on instructions for users in identifying usability problems. This paper reports from a comparative study of the effect of task assignments and instruction types on the problems identified in remote asynchronous usability testing of a website for information retrieval, involving 53 prospective users. The results show that users solving predefined tasks identified significantly more usability problems with a significantly higher level of agreement than those working on their own authentic tasks. Moreover, users that were instructed by means of examples of usability problems identified significantly more usability problems than those who received a conceptual definition of usability problems.