A critical investigation of recall and precision as measures of retrieval system performance
ACM Transactions on Information Systems (TOIS)
Rank aggregation methods for the Web
Proceedings of the 10th international conference on World Wide Web
Integrating contents and structure in text retrieval
ACM SIGMOD Record
XIRQL: a query language for information retrieval in XML documents
Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
The XXL search engine: ranked retrieval of XML data using indexes and ontologies
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Focussed Structured Document Retrieval
SPIRE 2002 Proceedings of the 9th International Symposium on String Processing and Information Retrieval
Searching XML documents via XML fragments
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
XRANK: ranked keyword search over XML documents
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Controlling overlap in content-oriented XML retrieval
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Evaluation in (XML) information retrieval: expected precision-recall with user modelling (EPRUM)
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
eXtended cumulated gain measures for the evaluation of content-oriented XML retrieval
ACM Transactions on Information Systems (TOIS)
Introduction to Probability Models, Ninth Edition
Introduction to Probability Models, Ninth Edition
Precision recall with user modeling (PRUM): Application to structured information retrieval
ACM Transactions on Information Systems (TOIS)
Sound and complete relevance assessment for XML retrieval
ACM Transactions on Information Systems (TOIS)
AxPRE Summaries: Exploring the (Semi-)Structure of XML Web Collections
ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
Representing User Navigation in XML Retrieval with Structural Summaries
ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
ACM SIGIR Forum
PRES: a score metric for evaluating recall-oriented information retrieval applications
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Expected reading effort in focused retrieval evaluation
Information Retrieval
ExpLOD: summary-based exploration of interlinking and RDF usage in the linked open data cloud
ESWC'10 Proceedings of the 7th international conference on The Semantic Web: research and Applications - Volume Part II
An analysis of an efficient data structure for evaluating flexible constraints on XML documents
FQAS'11 Proceedings of the 9th international conference on Flexible Query Answering Systems
A study on novelty evaluation in biomedical information retrieval
SPIRE'12 Proceedings of the 19th international conference on String Processing and Information Retrieval
Hi-index | 0.00 |
This paper presents a unified framework for the evaluation of a range of structured document retrieval (SDR) approaches and tasks. The framework is based on a model of tree retrieval, evaluated using a novel extension of the Structural elevance (SR) measure. The measure replaces the assumption of independence in traditional information retrieval (IR) with a notion of redundancy that takes into account the user navigation inside documents while seeking relevant information. Unlike existing metrics for SDR, our proposed framework does not require the computation of an ideal ranking which has, thus far, prevented the practical application of such measures. Instead, SR builds on a Markovian model of user navigation that can be estimated through the use of structural summaries. The results of this paper (supported by experimental validation using INEX data) show that SR defined over a tree retrieval model can provide a common basis for the evaluation of SDR approaches across various structured search tasks.