Complementary methods of system usability evaluation: Surveys and observations during software design and development cycles

Authors:
Jan Horsky;Kerry McColgan;Justine E. Pang;Andrea J. Melnikas;Jeffrey A. Linder;Jeffrey L. Schnipper;Blackford Middleton
Affiliations:
Clinical Informatics Research and Development, Partners HealthCare, Boston, USA and Division of General Medicine and Primary Care, Brigham and Women's Hospital, Boston, USA and Harvard Medical Sch ...;Clinical Informatics Research and Development, Partners HealthCare, Boston, USA;Clinical Informatics Research and Development, Partners HealthCare, Boston, USA;Clinical Informatics Research and Development, Partners HealthCare, Boston, USA;Clinical Informatics Research and Development, Partners HealthCare, Boston, USA and Division of General Medicine and Primary Care, Brigham and Women's Hospital, Boston, USA and Harvard Medical Sch ...;Clinical Informatics Research and Development, Partners HealthCare, Boston, USA and Division of General Medicine and Primary Care, Brigham and Women's Hospital, Boston, USA and Harvard Medical Sch ...;Clinical Informatics Research and Development, Partners HealthCare, Boston, USA and Division of General Medicine and Primary Care, Brigham and Women's Hospital, Boston, USA and Harvard Medical Sch ...
Venue:
Journal of Biomedical Informatics
Year:
2010

Citing 11
Cited 1

Designing for usability: key principles and what designers think

Communications of the ACM
Usability inspection methods

Usability inspection methods
Intent Specifications: An Approach to Building Human-Centered Specifications

IEEE Transactions on Software Engineering
TOG on Interface

TOG on Interface
Iterative User-Interface Design

Computer
Using usability heuristics to evaluate patient safety of medical devices

Journal of Biomedical Informatics - Patient safety
Designing the User Interface: Strategies for Effective Human-Computer Interaction (4th Edition)

Designing the User Interface: Strategies for Effective Human-Computer Interaction (4th Edition)
Primary care physician time utilization before and after implementation of an electronic health record: a time-motion study

Journal of Biomedical Informatics - Special issue: Human-centered computing in health information systems. Part 2: Evaluation
Heuristic evaluation of paper-based Web pages: a simplified inspection usability methodology

Journal of Biomedical Informatics
Tracing impact in a usability improvement process

Interacting with Computers
Development of a multiple heuristics evaluation table (MHET) to support software development and usability analysis

UAHCI'07 Proceedings of the 4th international conference on Universal access in human computer interaction: coping with diversity

Usability evaluation of digital dictation procedure - an interaction analysis approach

USAB'11 Proceedings of the 7th conference on Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society: information Quality in e-Health

Quantified Score

Hi-index	0.00

Visualization

Abstract

Poor usability of clinical information systems delays their adoption by clinicians and limits potential improvements to the efficiency and safety of care. Recurring usability evaluations are therefore, integral to the system design process. We compared four methods employed during the development of outpatient clinical documentation software: clinician email response, online survey, observations and interviews. Results suggest that no single method identifies all or most problems. Rather, each approach is optimal for evaluations at a different stage of design and characterizes different usability aspect. Email responses elicited from clinicians and surveys report mostly technical, biomedical, terminology and control problems and are most effective when a working prototype has been completed. Observations of clinical work and interviews inform conceptual and workflow-related problems and are best performed early in the cycle. Appropriate use of these methods consistently during development may significantly improve system usability and contribute to higher adoption rates among clinicians and to improved quality of care.