AskHERMES: An online question answering system for complex clinical questions

  • Authors:

  • YongGang Cao;Feifan Liu;Pippa Simpson;Lamont Antieau;Andrew Bennett;James J. Cimino;John Ely;Hong Yu

  • Affiliations:

  • Department of Health Sciences, University of Wisconsin-Milwaukee, Milwaukee, WI, USA;Department of Health Sciences, University of Wisconsin-Milwaukee, Milwaukee, WI, USA;Department of Pediatrics, Medical College of Wisconsin, Milwaukee, WI, USA;Department of Health Sciences, University of Wisconsin-Milwaukee, Milwaukee, WI, USA;Department of Psychiatry, Medical College of Wisconsin, Milwaukee, WI, USA and The Veterans Affairs Hospital, Milwaukee, WI, USA;Clinical Center, National Institutes of Health, Bethesda, MD, USA;Department of Family Medicine, University of Iowa Hospitals and Clinics, Iowa City, USA;Department of Health Sciences, University of Wisconsin-Milwaukee, Milwaukee, WI, USA and Department of Electrical Engineering and Computer Science, University of Wisconsin-Milwaukee, Milwaukee, WI ...

  • Venue:
  • Journal of Biomedical Informatics
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Objective: Clinical questions are often long and complex and take many forms. We have built a clinical question answering system named AskHERMES to perform robust semantic analysis on complex clinical questions and output question-focused extractive summaries as answers. Design: This paper describes the system architecture and a preliminary evaluation of AskHERMES, which implements innovative approaches in question analysis, summarization, and answer presentation. Five types of resources were indexed in this system: MEDLINE abstracts, PubMed Central full-text articles, eMedicine documents, clinical guidelines and Wikipedia articles. Measurement: We compared the AskHERMES system with Google (Google and Google Scholar) and UpToDate and asked physicians to score the three systems by ease of use, quality of answer, time spent, and overall performance. Results: AskHERMES allows physicians to enter a question in a natural way with minimal query formulation and allows physicians to efficiently navigate among all the answer sentences to quickly meet their information needs. In contrast, physicians need to formulate queries to search for information in Google and UpToDate. The development of the AskHERMES system is still at an early stage, and the knowledge resource is limited compared with Google or UpToDate. Nevertheless, the evaluation results show that AskHERMES' performance is comparable to the other systems. In particular, when answering complex clinical questions, it demonstrates the potential to outperform both Google and UpToDate systems. Conclusions: AskHERMES, available at http://www.AskHERMES.org, has the potential to help physicians practice evidence-based medicine and improve the quality of patient care.