Optimum polynomial retrieval functions based on the probability ranking principle
ACM Transactions on Information Systems (TOIS)
Automatic combination of multiple ranked retrieval systems
SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Information filtering based on user behavior analysis and best match text retrieval
SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Experience with an adaptive indexing scheme
CHI '85 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Analysis of a very large web search engine query log
ACM SIGIR Forum
Real life, real users, and real needs: a study and analysis of user queries on the web
Information Processing and Management: an International Journal
Gazetracker: software designed to facilitate eye movement analysis
ETRA '00 Proceedings of the 2000 symposium on Eye tracking research & applications
Proceedings of the 6th international conference on Intelligent user interfaces
Eye tracking in web search tasks: design implications
ETRA '02 Proceedings of the 2002 symposium on Eye tracking research & applications
Long-Term Learning for Web Search Engines
PKDD '02 Proceedings of the 6th European Conference on Principles of Data Mining and Knowledge Discovery
An Efficient Boosting Algorithm for Combining Preferences
ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
The Use of Implicit Evidence for Relevance Feedback in Web Retrieval
Proceedings of the 24th BCS-IRSG European Colloquium on IR Research: Advances in Information Retrieval
Optimizing search engines using clickthrough data
Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
ACM SIGIR Forum
Query word deletion prediction
Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Implicit feedback for inferring user preference: a bibliography
ACM SIGIR Forum
The determinants of web page viewing behavior: an eye-tracking study
Proceedings of the 2004 symposium on Eye tracking research & applications
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Depth- and breadth-first processing of search result lists
CHI '04 Extended Abstracts on Human Factors in Computing Systems
A community-aware search engine
Proceedings of the 13th international conference on World Wide Web
Display time as implicit feedback: understanding task effects
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Eye-tracking analysis of user behavior in WWW search
Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
Evaluating implicit measures to improve web search
ACM Transactions on Information Systems (TOIS)
A study of factors affecting the utility of implicit relevance feedback
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Context-sensitive information retrieval using implicit feedback
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Accurately interpreting clickthrough data as implicit feedback
Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Query chains: learning to rank from implicit feedback
Proceedings of the eleventh ACM SIGKDD international conference on Knowledge discovery in data mining
Learning to rank using gradient descent
ICML '05 Proceedings of the 22nd international conference on Machine learning
Learning user interaction models for predicting web search result preferences
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Improving web search ranking by incorporating user behavior information
SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Journal of Artificial Intelligence Research
Letizia: an agent that assists web browsing
IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 1
Active exploration for learning rankings from clickthrough data
Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
A Hybrid, Multi-dimensional Recommender for Journal Articles in a Scientific Digital Library
WI-IATW '07 Proceedings of the 2007 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Workshops
A probability ranking principle for interactive information retrieval
Information Retrieval
Externalities in online advertising
Proceedings of the 17th international conference on World Wide Web
An investigation on a community's web search variability
ACSC '08 Proceedings of the thirty-first Australasian conference on Computer science - Volume 74
How do users find things with PubMed?: towards automatic utility evaluation with user simulations
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
A user browsing model to predict search engine click data from past observations.
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Predicting information seeker satisfaction in community question answering
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Personalized search based on user intention through the hierarchical phrase vector model
ACC'08 Proceedings of the WSEAS International Conference on Applied Computing Conference
Revisiting Lexical Signatures to (Re-)Discover Web Pages
ECDL '08 Proceedings of the 12th European conference on Research and Advanced Technology for Digital Libraries
How does clickthrough data reflect retrieval quality?
Proceedings of the 17th ACM conference on Information and knowledge management
Are click-through data adequate for learning web search rankings?
Proceedings of the 17th ACM conference on Information and knowledge management
User intention based personalized search: HPS(hierarchical phrase search)
WSEAS Transactions on Circuits and Systems
Efficient multiple-click models in web search
Proceedings of the Second ACM International Conference on Web Search and Data Mining
Proceedings of the Second ACM International Conference on Web Search and Data Mining
A Cascade Model for Externalities in Sponsored Search
WINE '08 Proceedings of the 4th International Workshop on Internet and Network Economics
Analysis of long queries in a large scale search log
Proceedings of the 2009 workshop on Web Search Click Data
Tailoring click models to user goals
Proceedings of the 2009 workshop on Web Search Click Data
Modeling information-seeker satisfaction in community question answering
ACM Transactions on Knowledge Discovery from Data (TKDD)
Click chain model in web search
Proceedings of the 18th international conference on World wide web
Proceedings of the forty-first annual ACM symposium on Theory of computing
Learning and inferencing in user ontology for personalized Semantic Web search
Information Sciences: an International Journal
Interactively optimizing information retrieval systems as a dueling bandits problem
ICML '09 Proceedings of the 26th Annual International Conference on Machine Learning
Cost and benefit analysis of mediated enterprise search
Proceedings of the 9th ACM/IEEE-CS joint conference on Digital libraries
Modeling actions of PubMed users with n-gram language models
Information Retrieval
BBM: bayesian browsing model from petabyte-scale data
Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining
Modeling and predicting user behavior in sponsored search
Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining
Improving classification accuracy using automatically extracted training data
Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining
PSkip: estimating relevance ranking quality from web search clickthrough data
Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining
Effective use of search strategies
CIS'09 Proceedings of the international conference on Computational and information science 2009
Segment-level display time as implicit feedback: a comparison to eye tracking
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Search war: a game for improving web search
Proceedings of the ACM SIGKDD Workshop on Human Computation
Building a framework for the probability ranking principle by a family of expected weighted rank
ACM Transactions on Information Systems (TOIS)
Are Clickthroughs Useful for Image Labelling?
WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
In the Mood to Click? Towards Inferring Receptiveness to Search Advertising
WI-IAT '09 Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology - Volume 01
Analyzing and evaluating query reformulation strategies in web search logs
Proceedings of the 18th ACM conference on Information and knowledge management
Post-rank reordering: resolving preference misalignments between search engines and end users
Proceedings of the 18th ACM conference on Information and knowledge management
Exploring relevance for clicks
Proceedings of the 18th ACM conference on Information and knowledge management
Evaluation of methods for relative comparison of retrieval systems based on clickthroughs
Proceedings of the 18th ACM conference on Information and knowledge management
Image annotation using clickthrough data
Proceedings of the ACM International Conference on Image and Video Retrieval
Towards a model of implicit feedback for Web search
Journal of the American Society for Information Science and Technology
Exploiting bilingual information to improve web search
ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - Volume 2
A model to estimate intrinsic document relevance from the clickthrough logs of a web search engine
Proceedings of the third ACM international conference on Web search and data mining
Inferring search behaviors using partially observable Markov (POM) model
Proceedings of the third ACM international conference on Web search and data mining
A novel click model and its applications to online advertising
Proceedings of the third ACM international conference on Web search and data mining
ACM Transactions on Information Systems (TOIS)
A3CRank: An adaptive ranking method based on connectivity, content and click-through data
Information Processing and Management: an International Journal
Building taxonomy of web search intents for name entity queries
Proceedings of the 19th international conference on World wide web
Proceedings of the 19th international conference on World wide web
A frequency mining-based algorithm for re-ranking web search engine retrievals
Canadian AI'08 Proceedings of the Canadian Society for computational studies of intelligence, 21st conference on Advances in artificial intelligence
Using clicks as implicit judgments: expectations versus observations
ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
Investigating the effectiveness of clickthrough data for document reordering
ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
Mining Query Logs: Turning Search Usage Data into Knowledge
Foundations and Trends in Information Retrieval
Inferring document utility via a decision-making based retrieval model
International Journal of Knowledge-based and Intelligent Engineering Systems
Temporal click model for sponsored search
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Ready to buy or just browsing?: detecting web searcher goals from interaction data
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Understanding web browsing behaviors through Weibull analysis of dwell time
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Learning more powerful test statistics for click-based retrieval evaluation
Proceedings of the 33rd international ACM SIGIR conference on Research and development in information retrieval
Bayesian Browsing Model: Exact Inference of Document Relevance from Petabyte-Scale Data
ACM Transactions on Knowledge Discovery from Data (TKDD)
Putting the user in the loop: interactive Maximal Marginal Relevance for query-focused summarization
HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Inferring gender of movie reviewers: exploiting writing style, content and metadata
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
The anatomy of a click: modeling user behavior on web information systems
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Utilizing re-finding for personalized information retrieval
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
Fast active exploration for link-based preference learning using Gaussian processes
ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part III
Web Semantics: Science, Services and Agents on the World Wide Web
Personalizing web search using long term browsing history
Proceedings of the fourth ACM international conference on Web search and data mining
Detecting duplicate web documents using clickthrough data
Proceedings of the fourth ACM international conference on Web search and data mining
Inferring search behaviors using partially observable markov model with duration (POMD)
Proceedings of the fourth ACM international conference on Web search and data mining
Shopping for products you don't know you need
Proceedings of the fourth ACM international conference on Web search and data mining
Proceedings of the fourth ACM international conference on Web search and data mining
Learning to re-rank web search results with multiple pairwise features
Proceedings of the fourth ACM international conference on Web search and data mining
A probability click tracking model analysis of web search results
ICONIP'10 Proceedings of the 17th international conference on Neural information processing: theory and algorithms - Volume Part I
Evaluating search engines by clickthrough data
ISWC'10 Proceedings of the 9th international semantic web conference on The semantic web - Volume Part II
Effects of Usage-Based Feedback on Video Retrieval: A Simulation-Based Study
ACM Transactions on Information Systems (TOIS)
Towards a context-sensitive online newspaper
Proceedings of the 2011 Workshop on Context-awareness in Retrieval and Recommendation
Addressing people's information needs directly in a web search result page
Proceedings of the 20th international conference on World wide web
Learning to re-rank: query-dependent image re-ranking using click data
Proceedings of the 20th international conference on World wide web
Learning to rank with multiple objective functions
Proceedings of the 20th international conference on World wide web
No clicks, no problem: using cursor movements to understand and improve search
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Efficient diversity-aware search
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Inferring and using location metadata to personalize web search
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Efficiently collecting relevance information from clickthroughs for web retrieval system evaluation
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Improving local search ranking through external logs
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Knowledge effects on document selection in search results pages
Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Reliability and effectiveness of clickthrough data for automatic image annotation
Multimedia Tools and Applications
Search Engine Query Clustering Using Top-k Search Results
WI-IAT '11 Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Reranking search results for sparse queries
Proceedings of the 20th ACM international conference on Information and knowledge management
Context-aware search personalization with concept preference
Proceedings of the 20th ACM international conference on Information and knowledge management
Attentive documents: Eye tracking as implicit feedback for information retrieval and beyond
ACM Transactions on Interactive Intelligent Systems (TiiS)
A Survey of Automatic Query Expansion in Information Retrieval
ACM Computing Surveys (CSUR)
Large-scale validation and analysis of interleaved search evaluation
ACM Transactions on Information Systems (TOIS)
Proceedings of the fifth ACM international conference on Web search and data mining
Learning to rank with multi-aspect relevance for vertical search
Proceedings of the fifth ACM international conference on Web search and data mining
Interpreting user inactivity on search results
ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
Ranking with submodular valuations
Proceedings of the twenty-second annual ACM-SIAM symposium on Discrete Algorithms
Proceedings of the 21st international conference on World Wide Web
Large-scale machine learning at twitter
SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
Estimating importance of implicit factors in e-commerce recommender systems
Proceedings of the 2nd International Conference on Web Intelligence, Mining and Semantics
Analyzing and mining a code search engine usage log
Empirical Software Engineering
Online learning to diversify from implicit feedback
Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Web query disambiguation using PageRank
Journal of the American Society for Information Science and Technology
An exploration of ranking heuristics in mobile local search
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Re-examining search result snippet examination time for relevance estimation
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Text selections as implicit relevance feedback
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Using eye-tracking with dynamic areas of interest for analyzing interactive information retrieval
SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Multi-objective optimization for sponsored search
Proceedings of the Sixth International Workshop on Data Mining for Online Advertising and Internet Economy
On sociocultural aspects of user elicitation
Proceedings of the 4th Information Interaction in Context Symposium
Semantic preference retrieval for querying knowledge bases
Proceedings of the 1st Joint International Workshop on Entity-Oriented and Semantic Search
On caption bias in interleaving experiments
Proceedings of the 21st ACM international conference on Information and knowledge management
Serial position effects of clicking behavior on result pages returned by search engines
Proceedings of the 21st ACM international conference on Information and knowledge management
Quantitative analysis of search sessions enhanced by gaze tracking with dynamic areas of interest
TPDL'12 Proceedings of the Second international conference on Theory and Practice of Digital Libraries
Evaluating implicit judgments from image search clickthrough data
Journal of the American Society for Information Science and Technology
Learning to rank for spatiotemporal search
Proceedings of the sixth ACM international conference on Web search and data mining
Practical online retrieval evaluation
ECIR'13 Proceedings of the 35th European conference on Advances in Information Retrieval
Scaling big data mining infrastructure: the twitter experience
ACM SIGKDD Explorations Newsletter
All the news that's fit to read: a study of social annotations for news reading
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Summaries, ranked retrieval and sessions: a unified framework for information access evaluation
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Incorporating vertical results into search click models
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Beliefs and biases in web search
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Fighting search engine amnesia: reranking repeated results
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Toward whole-session relevance: exploring intrinsic diversity in web search
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Mining touch interaction data on mobile devices to predict web search result relevance
Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval
Which mechanism for sponsored search auctions with externalities?
Proceedings of the 2013 international conference on Autonomous agents and multi-agent systems
Captions and biases in diagnostic search
ACM Transactions on the Web (TWEB)
Click-boosting random walk for image search reranking
Proceedings of the Fifth International Conference on Internet Multimedia Computing and Service
Annotation for free: video tagging by mining user search behavior
Proceedings of the 21st ACM international conference on Multimedia
Pairwise learning in recommendation: experiments with community recommendation on linkedin
Proceedings of the 7th ACM conference on Recommender systems
Image search by graph-based label propagation with image representation from DNN
Proceedings of the 21st ACM international conference on Multimedia
Lerot: an online learning to rank framework
Proceedings of the 2013 workshop on Living labs for information retrieval evaluation
You have e-mail, what happens next? Tracking the eyes for genre
Information Processing and Management: an International Journal
Was this review helpful to you?: it depends! context and voting patterns in online content
Proceedings of the 23rd international conference on World wide web
Hi-index | 0.00 |
This article examines the reliability of implicit feedback generated from clickthrough data and query reformulations in World Wide Web (WWW) search. Analyzing the users' decision process using eyetracking and comparing implicit feedback against manual relevance judgments, we conclude that clicks are informative but biased. While this makes the interpretation of clicks as absolute relevance judgments difficult, we show that relative preferences derived from clicks are reasonably accurate on average. We find that such relative preferences are accurate not only between results from an individual query, but across multiple sets of results within chains of query reformulations.