Cognitive and usability engineering methods for the evaluation of clinical information systems
Journal of Biomedical Informatics
Journal of Biomedical Informatics - Special issue: Human-centered computing in health information systems. Part 1: Analysis and design
The trouble with login: on usability and computer security in ubiquitous computing
Personal and Ubiquitous Computing
International Journal of Human-Computer Studies
Cognitive properties of a whiteboard: a case study in a trauma centre
ECSCW'01 Proceedings of the seventh conference on European Conference on Computer Supported Cooperative Work
Electronic whiteboards in emergency medicine: a systematic review
Proceedings of the 2nd ACM SIGHIT International Health Informatics Symposium
User participation in implementation
Proceedings of the 12th Participatory Design Conference: Exploratory Papers, Workshop Descriptions, Industry Cases - Volume 2
| Hi-index | 0.00 |
As hospital departments continue to introduce electronic whiteboards in real clinical settings a range of human factor issues have emerged and it has become clear that there is a need for improved methods for designing and testing these systems. In this study, we employed a longitudinal and naturalistic method in the usability evaluation of an electronic whiteboard system. The goal of the evaluation was to explore the extent to which usability issues experienced by users change as they gain more experience with the system. In addition, the paper explores the use of a new approach to collection and analysis of continuous digital video recordings of naturalistic ''live'' user interactions. The method developed and employed in the study included recording the users' interactions with system during actual use using screen-capturing software and analyzing these recordings for usability issues. In this paper we describe and discuss both the method and the results of the evaluation. We found that the electronic whiteboard system contains system-related usability issues that did not change over time as the clinicians collectively gained more experience with the system. Furthermore, we also found user-related issues that seemed to change as the users gained more experience and we discuss the underlying reasons for these changes. We also found that the method used in the study has certain advantages over traditional usability evaluation methods, including the ability to collect analyze live user data over time. However, challenges and drawbacks to using the method (including the time taken for analysis and logistical issues in doing live recordings) should be considered before utilizing a similar approach. In conclusion we summarize our findings and call for an increased focus on longitudinal and naturalistic evaluations of health information systems and encourage others to apply and refine the method utilized in this study.