The overlap problem in content-oriented XML retrieval evaluation

  • Authors:
  • Gabriella Kazai;Mounia Lalmas;Arjen P. de Vries

  • Affiliations:
  • Queen Mary University of London, London, UK;Queen Mary University of London, London, UK;CWI, Amsterdam, The Netherlands

  • Venue:
  • Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Within the INitiative for the Evaluation of XML Retrieval(INEX) a number of metrics to evaluate the effectiveness of content-oriented XML retrieval approaches were developed. Although these metrics provide a solution towards addressing the problem of overlapping result elements, they do not consider the problem of overlapping reference components within the recall-base, thus leading to skewed effectiveness scores. We propose alternative metrics that aim to provide a solution to both overlap issues.