Monte Carlo methods. Vol. 1: basics
Monte Carlo methods. Vol. 1: basics
A general language model for information retrieval (poster abstract)
Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Using temporal profiles of queries for precision prediction
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Predicting query difficulty on the web by learning visual clues
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Document quality models for web ad hoc retrieval
Proceedings of the 14th ACM international conference on Information and knowledge management
Estimation and use of uncertainty in pseudo-relevance feedback
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Query performance prediction in web search environments
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Performance prediction using spatial autocorrelation
SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
Enhancing digital libraries using missing content analysis
Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries
Measuring ranked list robustness for query performance prediction
Knowledge and Information Systems
Adapting information retrieval systems to user queries
Information Processing and Management: an International Journal
Active relevance feedback for difficult queries
Proceedings of the 17th ACM conference on Information and knowledge management
Query performance prediction for information retrieval based on covering topic score
Journal of Computer Science and Technology
Reducing long queries using query quality predictors
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Comparing both relevance and robustness in selection of web ranking functions
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Estimating query performance using class predictions
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
A Belief Model of Query Difficulty That Uses Subjective Logic
ICTIR '09 Proceedings of the 2nd International Conference on Theory of Information Retrieval: Advances in Information Retrieval Theory
Predicting Query Performance by Query-Drift Estimation
ICTIR '09 Proceedings of the 2nd International Conference on Theory of Information Retrieval: Advances in Information Retrieval Theory
A term dependency-based approach for query terms ranking
Proceedings of the 18th ACM conference on Information and knowledge management
Incorporating robustness into web ranking evaluation
Proceedings of the 18th ACM conference on Information and knowledge management
Measuring system performance and topic discernment using generalized adaptive-weight mean
Proceedings of the 18th ACM conference on Information and knowledge management
Selecting Effective Terms for Query Formulation
AIRS '09 Proceedings of the 5th Asia Information Retrieval Symposium on Information Retrieval Technology
Predicting Neighbor Goodness in Collaborative Filtering
FQAS '09 Proceedings of the 8th International Conference on Flexible Query Answering Systems
Effective pre-retrieval query performance prediction using similarity and variability evidence
ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
The case retrieval strategy based on predicting query performance
FSKD'09 Proceedings of the 6th international conference on Fuzzy systems and knowledge discovery - Volume 2
Using statistical decision theory and relevance models for query-performance prediction
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
A comparison of user and system query performance predictions
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Diagnostic Evaluation of Information Retrieval Models
ACM Transactions on Information Systems (TOIS)
A large-scale system evaluation on component-level
ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
User perspectives on query difficulty
ICTIR'11 Proceedings of the Third international conference on Advances in information retrieval theory
A unified framework for post-retrieval query-performance prediction
ICTIR'11 Proceedings of the Third international conference on Advances in information retrieval theory
Predicting query performance via classification
ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
Query performance prediction: evaluation contrasted with effectiveness
ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
A performance prediction approach to enhance collaborative filtering performance
ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
Predicting Query Performance by Query-Drift Estimation
ACM Transactions on Information Systems (TOIS)
Predicting query performance directly from score distributions
AIRS'11 Proceedings of the 7th Asia conference on Information Retrieval Technology
Proceedings of the 27th Annual ACM Symposium on Applied Computing
Query difficulty estimation for image retrieval
Neurocomputing
Adaptive query suggestion for difficult queries
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Query performance prediction for IR
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Keyphrase extraction through query performance prediction
Journal of Information Science
Predicting query performance for fusion-based retrieval
Proceedings of the 21st ACM international conference on Information and knowledge management
Back to the roots: a probabilistic framework for query-performance prediction
Proceedings of the 21st ACM international conference on Information and knowledge management
Predicting the effectiveness of keyword queries on databases
Proceedings of the 21st ACM international conference on Information and knowledge management
Query-performance prediction and cluster ranking: two sides of the same coin
Proceedings of the 21st ACM international conference on Information and knowledge management
Playing by the rules: mining query associations to predict search performance
Proceedings of the sixth ACM international conference on Web search and data mining
Using document-quality measures to predict web-search effectiveness
ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
Increasing evaluation sensitivity to diversity
Information Retrieval
Modeling dwell time to predict click-level satisfaction
Proceedings of the 7th ACM international conference on Web search and data mining
Document Score Distribution Models for Query Performance Inference and Prediction
ACM Transactions on Information Systems (TOIS)
ACM Transactions on the Web (TWEB)
Combining pre-retrieval query quality predictors using genetic programming
Applied Intelligence
Hi-index | 0.00 |
In this paper, we introduce the notion of ranking robustness, which refers to a property of a ranked list of documents that indicates how stable the ranking is in the presence of uncertainty in the ranked documents. We propose a statistical measure called the robustness score to quantify this notion. We demonstrate that the robustness score significantly and consistently correlates with query performance in a variety of TREC test collections including the GOV2 collection. We compare the robustness score with the clarity score method which is the state-of-the-art technique for query performance prediction. Our experimental results show that the robustness score performs better than or at least as good as the clarity score. We find that the clarity score is barely correlated with query performance on the GOV2 collection while the correlation between the robustness score and query performance remains significant. We also notice that a combination of the two usually results in more prediction power.