Electronic rating of objective structured clinical examinations: mobile digital forms beat paper and pencil checklists in a comparative study

  • Authors:
  • Felix M. Schmitz;Philippe G. Zimmermann;Kevin Gaunt;Markus Stolze;Sissel Guttormsen Schär

  • Affiliations:
  • Institute of Medical Education, University of Bern, Bern, Switzerland;Institute of Medical Education, University of Bern, Bern, Switzerland;Institute for Software, University of Applied Science, Rapperswil, Switzerland;Institute for Software, University of Applied Science, Rapperswil, Switzerland;Institute of Medical Education, University of Bern, Bern, Switzerland

  • Venue:
  • USAB'11 Proceedings of the 7th conference on Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society: information Quality in e-Health
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

During a two-day objective structured clinical examination (OSCE), we compared two types of checklists for student performance ratings: paper & pencil vs. digital checklists on iPads. Several subjective and objective measures from 10 examiners were collected and computed. Data showed that digital checklists were perceived as significantly more usable and less exertive and were also preferred in overall ratings. Assessments completed with digital checklists were found to have no missing items while assessments completed with paper checklists contained more than 8 blank items on average. Finally, checklist type did not influence assessment scores even though when using digital checklists more item-choice changes were produced.