Pivoted document length normalization
SIGIR '96 Proceedings of the 19th annual international ACM SIGIR conference on Research and development in information retrieval
Query-based sampling of text databases
ACM Transactions on Information Systems (TOIS)
Information Retrieval
Assessing bias in search engines
Information Processing and Management: an International Journal
Search engine coverage bias: evidence and possible causes
Information Processing and Management: an International Journal
Information retrieval system evaluation: effort, sensitivity, and reliability
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Relevance weighting for query independent evidence
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
The web structure of e-government - developing a methodology for quantitative evaluation
Proceedings of the 15th international conference on World Wide Web
Automatic construction of known-item finding test beds
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
The discoverability of the web
Proceedings of the 16th international conference on World Wide Web
WIC: a general-purpose algorithm for monitoring web information sources
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Evaluating epistemic uncertainty under incomplete assessments
Information Processing and Management: an International Journal
Accessibility in information retrieval
ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
Analyzing Document Retrievability in Patent Retrieval Settings
DEXA '09 Proceedings of the 20th International Conference on Database and Expert Systems Applications
Improving search engines using human computation games
Proceedings of the 18th ACM conference on Information and knowledge management
Improving retrievability of patents with cluster-based pseudo-relevance feedback documents selection
Proceedings of the 18th ACM conference on Information and knowledge management
Identification of low/high retrievable patents using content-based features
Proceedings of the 2nd international workshop on Patent information retrieval
Proceedings of the 19th international conference on World wide web
PRES: a score metric for evaluating recall-oriented information retrieval applications
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
On the relationship between effectiveness and accessibility
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Reverted indexing for feedback and expansion
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Improving access to large patent corpora
Transactions on large-scale data- and knowledge-centered systems II
Improving retrievability and recall by automatic corpus partitioning
Transactions on large-scale data- and knowledge-centered systems II
Improving retrievability and recall by automatic corpus partitioning
Transactions on large-scale data- and knowledge-centered systems II
Building queries for prior-art search
IRFC'11 Proceedings of the Second international conference on Multidisciplinary information retrieval facility
Improving retrievability of patents in prior-art search
ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
Improving retrievability with improved cluster-based pseudo-relevance feedback selection
Expert Systems with Applications: An International Journal
An initial investigation on the relationship between usage and findability
ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
Leveraging conceptual lexicon: query disambiguation using proximity information for patent retrieval
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Relating retrievability, performance and length
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
From keywords to keyqueries: content descriptors for the web
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Hi-index | 0.00 |
Evaluation in Information Retrieval (IR) has long focused on effectiveness and efficiency. However, new and emerging access tasks now demand alternative evaluation measures which go beyond this traditional view. A retrieval system provides a means of gaining access to documents, therefore intuitively, our view of the collection is shaped by the retrieval system. In this paper, we outline some emerging information access related scenarios that require knowledge about how the retrieval system affects the users' ability to access information. This provides the motivation for the proposed evaluation measures and methodology where the focus is on capturing the behavior of the system, in terms of how retrievable it makes individual documents within the collection. To demonstrate the utility of the proposed methods, we perform an extensive analysis on two TREC collections showing how the measures can be applied to evaluate different information access questions. For higher order information access tasks that are inherently dependent on retrievability, our novel evaluation methodology emphasizes that effectiveness is an insufficient characterization of a retrieval system. This paper provides the foundations for the evaluation of higher order access related tasks.