Evaluating the effectiveness of content-oriented XML retrieval methods

Authors:
Norbert Gövert;Norbert Fuhr;Mounia Lalmas;Gabriella Kazai
Affiliations:
University of Dortmund, Dortmund, Germany;University of Duisburg-Essen, Duisburg, Germany;Queen Mary University, London, UK;Queen Mary University, London, UK
Venue:
Information Retrieval
Year:
2006

Citing 0
Cited 6

eXtended cumulated gain measures for the evaluation of content-oriented XML retrieval

ACM Transactions on Information Systems (TOIS)
Evaluating XML retrieval effectiveness at INEX

ACM SIGIR Forum
Evaluation effort, reliability and reusability in XML retrieval

Journal of the American Society for Information Science and Technology
Specificity aboutness in XML retrieval

Information Retrieval
Processing keyword search on XML: a survey

World Wide Web
Contextualization using hyperlinks and internal hierarchical structure of Wikipedia documents

Proceedings of the 21st ACM international conference on Information and knowledge management

Quantified Score

Hi-index	0.00

Visualization

Abstract

Content-oriented XML retrieval approaches aim at a more focused retrieval strategy: Instead of retrieving whole documents, document components that are exhaustive to the information need while at the same time being as specific as possible should be retrieved. In this article, we show that the evaluation methods developed for standard retrieval must be modified in order to deal with the structure of XML documents. More precisely, the size and overlap of document components must be taken into account. For this purpose, we propose a new effectiveness metric based on the definition of a concept space defined upon the notions of exhaustiveness and specificity of a search result. We compare the results of this new metric by the results obtained with the official metric used in INEX, the evaluation initiative for content-oriented XML retrieval.