Using coherence-based measures to predict query difficulty

Authors:
Jiyin He;Martha Larson;Maarten De Rijke
Affiliations:
ISLA, University of Amsterdam;ISLA, University of Amsterdam;ISLA, University of Amsterdam
Venue:
ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
Year:
2008

Citing 6
Cited 14

Predicting query performance

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
The NRRC reliable information access (RIA) workshop

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
The TREC robust retrieval track

ACM SIGIR Forum
Learning to estimate query difficulty: including applications to missing content detection and distributed information retrieval

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Query performance prediction

Information Systems
Quantifying query ambiguity

HLT '02 Proceedings of the second international conference on Human Language Technology Research

Blogger, stick to your story: modeling topical noise in blogs with coherence measures

Proceedings of the second workshop on Analytics for noisy unstructured text data
A survey of pre-retrieval query performance predictors

Proceedings of the 17th ACM conference on Information and knowledge management
The Combination and Evaluation of Query Performance Prediction Methods

ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
Reducing long queries using query quality predictors

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Topic structure for information retrieval

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
A generative blog post retrieval model that uses query expansion based on external collections

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
A comparison of user and system query performance predictions

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Exploiting noisy visual concept detection to improve spoken content based video retrieval

Proceedings of the international conference on Multimedia
Explaining query modifications: an alternative interpretation of term addition and removal

ECIR'12 Proceedings of the 34th European conference on Advances in Information Retrieval
Credibility-inspired ranking for blog post retrieval

Information Retrieval
Estimating query difficulty for news prediction retrieval

Proceedings of the 21st ACM international conference on Information and knowledge management
Leading people to longer queries

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A learning approach to optimizing exploration---exploitation tradeoff in relevance feedback

Information Retrieval
Combining pre-retrieval query quality predictors using genetic programming

Applied Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

We investigate the potential of coherence-based scores to predict query difficulty. The coherence of a document set associated with each query word is used to capture the quality of a query topic aspect. A simple query coherence score, QC-1, is proposed that requires the average coherence contribution of individual query terms to be high. Two further query scores, QC-2 and QC-3, are developed by constraining QC- 1 in order to capture the semantic similarity among query topic aspects. All three query coherence scores show the correlation with average precision necessary to make them good predictors of query difficulty. Simple and efficient, the measures require no training data and are competitive with language model-based clarity scores.