Knowledge elicitation for validation of a neonatal ventilation expert system utilising modified Delphi and focus group techniques

Authors:
Kenneth Tan;Gordon Baxter;Simon Newell;Steve Smye;Peter Dear;Keith Brownlee;Jonathan Darling
Affiliations:
Department of Paediatrics, St. James's University Hospital, Beckett Street, Leeds, West Yorkshire LS9 7TF, United Kingdom;School of Computer Science, University of St Andrews, North Haugh, St Andrews KY16 9SX, United Kingdom;Department of Paediatrics, St. James's University Hospital, Beckett Street, Leeds, West Yorkshire LS9 7TF, United Kingdom;Department of Medical Engineering, St. James's University Hospital, Beckett Street, Leeds, West Yorkshire LS9 7TF, United Kingdom;Department of Paediatrics, St. James's University Hospital, Beckett Street, Leeds, West Yorkshire LS9 7TF, United Kingdom;Department of Paediatrics, St. James's University Hospital, Beckett Street, Leeds, West Yorkshire LS9 7TF, United Kingdom;Department of Paediatrics, St. James's University Hospital, Beckett Street, Leeds, West Yorkshire LS9 7TF, United Kingdom
Venue:
International Journal of Human-Computer Studies
Year:
2010

Citing 5
Cited 1

Knowledge elicitation: principle, techniques and applications

Knowledge elicitation: principle, techniques and applications
Varieties of knowledge elicitation techniques

International Journal of Human-Computer Studies
Focus Groups as a Knowledge Elicitation Technique: An Exploratory Study

IEEE Transactions on Knowledge and Data Engineering
Discourse Analysis of Requirements and Knowledge Elicitation Interviews

HICSS '02 Proceedings of the 35th Annual Hawaii International Conference on System Sciences (HICSS'02)-Volume 8 - Volume 8
Using cognitive task analysis to facilitate the integration of decision support systems into the neonatal intensive care unit

Artificial Intelligence in Medicine

Detecting and resolving inconsistencies between domain experts' different perspectives on (classification) tasks

Artificial Intelligence in Medicine

Quantified Score

Hi-index	0.00

Visualization

Abstract

Objective, methods & materials, results: It is well known that ventilation strategies for newborn infants may vary significantly between individual doctors. The aim of this study was to elicit knowledge of ventilation management to provide a baseline for evaluating the performance of an expert system for neonatal ventilation (FLORENCE). The modified Delphi method and focus group techniques were used to arrive at consensus management strategies on 40 hypothetical ventilation scenarios. The underlying cognitive processes of the experts were also explored further to assist in the development of the expert system. The strategies arrived at were used to provide a performance level which FLORENCE was tested against. The solutions were judged to be equivalent between FLORENCE and neonatologists in 29 of the 40 cases. In the remaining 11 scenarios; FLORENCE also provided adequate solutions. Conclusions: The focus group technique was more effective than modified Delphi method in achieving consensus on ventilation management. This consensus on ventilation was used as the baseline to evaluate the performance of an expert system.