A grounded procedure for managing data and sample size of a home medical device assessment

Authors:
Simone Borsci;Jennifer L. Martin;Julie Barnett
Affiliations:
School of Information Systems, Computing and Mathematics, Brunel University, Uxbridge, Middlesex, UK;Department of Electrical and Electronic Engineering, University of Nottingham, University Park, Nottingham, UK;School of Information Systems, Computing and Mathematics, Brunel University, Uxbridge, Middlesex, UK
Venue:
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: human-centred design approaches, methods, tools, and environments - Volume Part I
Year:
2013

Citing 5
Cited 0

Refining the test phase of usability evaluation: how many subjects is enough?

Human Factors - Special issue: measurement in human factors
A mathematical model of the finding of usability problems

INTERCHI '93 Proceedings of the INTERCHI '93 conference on Human factors in computing systems
From cognitive compatibility to the disappearing computer: experience design for smart environments

ECCE '08 Proceedings of the 15th European conference on Cognitive ergonomics: the ergonomics of cool interaction
Heterogeneity in the usability evaluation process

BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 1
Sample size in usability studies

Communications of the ACM

Quantified Score

Hi-index	0.00

Visualization

Abstract

The selection of participants for usability assessment, together with the minimum number of subjects required to obtain a set of reliable data, is a hot topic in Human Computer Interaction (HCI). Albeit, prominent contributions through the application of different p estimation models argued that five users provide a good benchmark when seeking to discover interaction problems a lot of studies have complained this five-user assumption. The sample size topic is today a central issue for the assessment of critical-systems, such as medical devices, because lacks in usability and, moreover, in the safety in use of these kind of products may seriously damage the final users. We argue that rely on one-size-fits-all solutions, such as the five-user assumption (for websites) or the mandated size of 15 users for major group (for medical device) lead manufactures to release unsafe product. Nevertheless, albeit there are no magic numbers for determining "a priori" the cohort size, by using a specific procedure it is possible to monitoring the sample discovery likelihood after the first five users in order to obtain reliable information about the gathered data and determine whether the problems discovered by the sample have a certain level of representativeness (i.e., reliability). We call this approach "Grounded Procedure" (GP).The goal of this study is to present the GP assumptions and steps, by exemplifying its application in the assessment of a home medical device.