A critical investigation of recall and precision as measures of retrieval system performance
ACM Transactions on Information Systems (TOIS)
Variations in relevance judgments and the measurement of retrieval effectiveness
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Evaluating evaluation measure stability
SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Modern Information Retrieval
Using graded relevance assessments in IR evaluation
Journal of the American Society for Information Science and Technology
The overlap problem in content-oriented XML retrieval evaluation
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Preparing heterogeneous XML for full-text search
ACM Transactions on Information Systems (TOIS)
Evaluating XML retrieval effectiveness at INEX
ACM SIGIR Forum
Relevance measures for XML information retrieval
International Journal of Web and Grid Services
A new interpretation of average precision
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Structural relevance: a common basis for the evaluation of structured document retrieval
Proceedings of the 17th ACM conference on Information and knowledge management
Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
Return specification inference and result clustering for keyword search on XML
ACM Transactions on Database Systems (TODS)
Improving XML search by generating and utilizing informative result snippets
ACM Transactions on Database Systems (TODS)
Expected reading effort in focused retrieval evaluation
Information Retrieval
Contextualization using hyperlinks and internal hierarchical structure of Wikipedia documents
Proceedings of the 21st ACM international conference on Information and knowledge management
Model Based Comparison of Discounted Cumulative Gain and Average Precision
Journal of Discrete Algorithms
A linear and monotonic strategy to keyword search over RDF data
ICWE'13 Proceedings of the 13th international conference on Web Engineering
| Hi-index | 0.00 |
Standard Information Retrieval (IR) metrics assume a simple model where documents are understood as independent units. Such an assumption is not adapted to new paradigms like XML or Web IR where retrievable informations are parts of documents or sets of related documents. Moreover, classical hypotheses assumes that the user ignores the structural or logical context of document elements and hence the possibility of navigation between units. EPRUM is a generalisation of Precision-Recall (PR) that aims at allowing the user to navigate or browse in the corpus structure. Like the Cumulated Gain metrics, it is able to handle continuous valued relevance. We apply and compare EPRUM in the context of XML Retrieval -- a very active field for evaluation metrics. We also explain how EPRUM can be used in other IR paradigms.