Usefulness of quality click-through data for training

Authors:
Craig Macdonald;Iadh Ounis
Affiliations:
University of Glasgow, Scotland, UK;University of Glasgow, Scotland, UK
Venue:
Proceedings of the 2009 workshop on Web Search Click Data
Year:
2009

Citing 10
Cited 8

Optimizing search engines using clickthrough data

Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
A taxonomy of web search

ACM SIGIR Forum
Understanding user goals in web search

Proceedings of the 13th international conference on World Wide Web
A temporal comparison of AltaVista Web searching: Research Articles

Journal of the American Society for Information Science and Technology
Learning to rank using gradient descent

ICML '05 Proceedings of the 22nd international conference on Machine learning
Learning user interaction models for predicting web search result preferences

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
A support vector method for optimizing average precision

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Learning to rank for information retrieval (LR4IR 2007)

ACM SIGIR Forum
Determining the informational, navigational, and transactional intent of Web queries

Information Processing and Management: an International Journal
University of glasgow at WebCLEF 2005: experiments in per-field normalisation and language specific stemming

CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories

Improving quality of training data for learning to rank using click-through data

Proceedings of the third ACM international conference on Web search and data mining
Implicit visual concept modeling in image / video annotation

Proceedings of the first ACM international workshop on Analysis and retrieval of tracked events and motion in imagery streams
Reliability and effectiveness of clickthrough data for automatic image annotation

Multimedia Tools and Applications
On the creation of visual models for keywords through crowdsourcing

ACA'12 Proceedings of the 11th international conference on Applications of Electrical and Computer Engineering
Deriving query intents from web search engine queries

Journal of the American Society for Information Science and Technology
Topic modelling of clickthrough data in image search

Multimedia Tools and Applications
The whens and hows of learning to rank for web search

Information Retrieval
Automatic annotation of image databases based on implicit crowdsourcing, visual concept modeling and evolution

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

Modern Information Retrieval (IR) systems often employ document weighting models with many parameters that require to be appropriately set for effective retrieval performance. To obtain these parameter settings, quality training is usually required, where assessors have manually labelled the relevance of retrieved items for many queries. In this work, we examine the usefulness of high-quality click-through data for training an IR system, on searching the .gov vertical domain of the Web. We find that, compared to training using relevance judgements created using human assessors, the click-through trained settings are as good and occasionally better.