Using local precision to compare search engines in consumer health information retrieval

  • Authors:
  • Carla Teixeira Lopes;Cristina Ribeiro

  • Affiliations:
  • Faculdade de Engenharia da Universidade do Porto, Porto, Portugal;Faculdade de Engenharia da Universidade do Porto , Porto, Portugal

  • Venue:
  • Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We have conducted a user study to evaluate several generalist and health-specific search engines on health information retrieval. Users evaluated the relevance of the top 30 documents of 4 search engines in two different health information needs. We introduce the concepts of local and global precision and analyze how they affect the evaluation. Results show that Google surpasses the precision of all other engines, including the health-specific ones, and that precision differs with the type of clinical question and its medical specialty.