A survey on the use of relevance feedback for information access systems

Authors:
Ian Ruthven;Mounia Lalmas
Affiliations:
Department of Computer and Information Sciences, University of Strathclyde, Glasgow, G1 1XH/ e-mail: Ian.Ruthven@cis.strath.ac.uk;Department of Computer Science, Queen Mary, University of London, London, E1 4NS/ e-mail: mounia@dcs.qmul.ac.uk
Venue:
The Knowledge Engineering Review
Year:
2003

Citing 62
Cited 89

A total relevance and document interaction effects model for the evaluation of information retrieval processes

Information Processing and Management: an International Journal
Relevance feedback in a public access catalogue for a research library: MUSCAT at the Scott Polar Research Institute Library

Program
Towards interactive query expansion

SIGIR '88 Proceedings of the 11th annual international ACM SIGIR conference on Research and development in information retrieval
All users of information retrieval systems are not created equal: an exploration into individual differences

Information Processing and Management: an International Journal
A behavioral approach to information retrieval system design

Journal of Documentation
Where should the person stop and the information search interface start?

Information Processing and Management: an International Journal
On term selection for query expansion

Journal of Documentation
A probabilistic learning approach for document indexing

ACM Transactions on Information Systems (TOIS) - Special issue on research and development in information retrieval
Relevance feedback and other query modification techniques

Information retrieval
Ranking algorithms

Information retrieval
Information retrieval interaction

Information retrieval interaction
Relevance feedback revisited

SIGIR '92 Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval
Incremental relevance feedback

SIGIR '92 Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval
Selection of search terms based on user profile

SAC '92 Proceedings of the 1992 ACM/SIGAPP Symposium on Applied computing: technological challenges of the 1990's
Relevance feedback and inference networks

SIGIR '93 Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval
A user-centred evaluation of ranking algorithms for interactive query expansion

SIGIR '93 Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval
An expert system approach to online catalog subject searching

Information Processing and Management: an International Journal
The relationship between recall and precision

Journal of the American Society for Information Science
The relevance of recall and precision in user evaluation

Journal of the American Society for Information Science - Special issue: relevance research
Polyrepresentation of information needs and semantic entities: elements of a cognitive theory for information retrieval interaction

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
A probabilistic terminological logic for modelling information retrieval

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Some simple effective approximations to the 2-Poisson model for probabilistic weighted retrieval

SIGIR '94 Proceedings of the 17th annual international ACM SIGIR conference on Research and development in information retrieval
Overview of the second text retrieval conference (TREC-2)

TREC-2 Proceedings of the second conference on Text retrieval conference
Combining the evidence of multiple query representations for information retrieval

TREC-2 Proceedings of the second conference on Text retrieval conference
User choices: a new yardstick for the evaluation of ranking algorithms for interactive query expansion

Information Processing and Management: an International Journal
Information processing in the context of medical care

SIGIR '95 Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval
Users' models of the information space: the case for two search models

SIGIR '95 Proceedings of the 18th annual international ACM SIGIR conference on Research and development in information retrieval
Why are online catalogs still hard to use?

Journal of the American Society for Information Science - Special issue: current research in online public access systems
Multiple search sessions model of end-user behavior: an exploratory study

Journal of the American Society for Information Science
A case for interaction: a study of interactive information retrieval behavior and effectiveness

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The effect of accessing nonmatching documents on relevance feedback

ACM Transactions on Information Systems (TOIS)
The potential and actual effectiveness of interactive query expansion

Proceedings of the 20th annual international ACM SIGIR conference on Research and development in information retrieval
Interaction in information retrieval: selection and effectiveness of search terms

Journal of the American Society for Information Science
Augmenting a characterization network with semantic information

Information Processing and Management: an International Journal
Improving relevance feedback in the vector space model

CIKM '97 Proceedings of the sixth international conference on Information and knowledge management
On relevance, probabilistic indexing and information retrieval

Readings in information retrieval
Users' criteria for relevance evaluation: a cross-situational comparison

Information Processing and Management: an International Journal
Improving automatic query expansion

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Boolean search: current state and perspectives

Journal of the American Society for Information Science - Special topic issue: youth issues in information science
From highly relevant to not relevant: examining different regions of relevance

Information Processing and Management: an International Journal
Combining the evidence of different relevance feedback methods for information retrieval

Information Processing and Management: an International Journal
Overview of the sixth text REtrieval conference (TREC-6)

Information Processing and Management: an International Journal - The sixth text REtrieval conference (TREC-6)
Relevance and contributing information types of searched documents in task performance

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
Relevance feedback with a small number of relevance judgements: incremental relevance feedback vs. document clustering

SIGIR '00 Proceedings of the 23rd annual international ACM SIGIR conference on Research and development in information retrieval
A probabilistic model of information retrieval: development and comparative experiments

Information Processing and Management: an International Journal
A probabilistic model of information retrieval: development and comparative experiments Part 2

Information Processing and Management: an International Journal
Empirical investigations on query modification using abductive explanations

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Combining and selecting characteristics of information use

Journal of the American Society for Information Science and Technology
Information Retrieval

Information Retrieval
Information Retrieval: Uncertainty and Logics: Advanced Models for the Representation and Retrieval of Information

Information Retrieval: Uncertainty and Logics: Advanced Models for the Representation and Retrieval of Information
Modern Information Retrieval

Modern Information Retrieval
Interactive Evaluation of the Ostensive ModelUsing a New Test Collection of Images with Multiple Relevance Assessments

Information Retrieval
On the Use of Explanations as Mediating Device for Relevance Feedback

ECDL '02 Proceedings of the 6th European Conference on Research and Advanced Technology for Digital Libraries
The Perils of Interpreting Recall and Precision Values

Proceedings of the GI/GMD-Workshop on Information Retrieval
An Image Retrieval System Based on the Visualization of System Relevance via Documents

DEXA '97 Proceedings of the 8th International Conference on Database and Expert Systems Applications
Incorporating user search behavior into relevance feedback

Journal of the American Society for Information Science and Technology
A task-oriented study on the influencing effects of query-biased summarisation in web searching

Information Processing and Management: an International Journal
The SMART Retrieval System—Experiments in Automatic Document Processing

The SMART Retrieval System—Experiments in Automatic Document Processing
The text retrieval conferences (TRECS)

TIPSTER '98 Proceedings of a workshop on held at Baltimore, Maryland: October 13-15, 1998
Independence of contributing retrieval strategies in data fusion for effective information retrieval

IRSG'98 Proceedings of the 20th Annual BCS-IRSG conference on Information Retrieval Research
Toward a theoretical framework for information retrieval (IR) evaluation in an information seeking context

MIRA'99 Proceedings of the 1999 international conference on Final Mira
Supporting information needs by ostensive definition in an adaptive information space

MIRO'95 Proceedings of the Final conference on Multimedia Information Retrieval

Better than the real thing?: iterative pseudo-query processing using cluster-based language models

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Relevance information: a loss of entropy but a gain for IDF?

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
PageRank without hyperlinks: structural re-ranking using links induced by language models

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Personalizing search via automated analysis of interests and activities

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
Mutual relevance feedback for multimodal query formulation in video retrieval

Proceedings of the 7th ACM SIGMM international workshop on Multimedia information retrieval
Adaptive relevance feedback method of extended boolean model using hierarchical clustering techniques

Information Processing and Management: an International Journal
Query reformulation using automatically generated query concepts from a document space

Information Processing and Management: an International Journal
Find-similar: similarity browsing as a search tool

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Efficient query expansion with auxiliary data structures

Information Systems
Combining bibliometrics, information retrieval, and relevance theory, Part 2: Some implications for information science: Research Articles

Journal of the American Society for Information Science and Technology
A review of ontology based query expansion

Information Processing and Management: an International Journal
An efficient indexing structure for content based multimedia retrieval with relevance feedback

Proceedings of the 2007 ACM symposium on Applied computing
Towards robust query expansion: model selection in the language modeling framework

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Making mind and machine meet: a study of combining cognitive and algorithmic relevance feedback

SIGIR '07 Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval
Exploiting underrepresented query aspects for automatic query expansion

Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining
Query expansion and dimensionality reduction: Notions of optimality in Rocchio relevance feedback and latent semantic indexing

Information Processing and Management: an International Journal
Review article: A review of structured document retrieval (SDR) technology to improve information access performance in engineering document management

Computers in Industry
Re-examining the effects of adding relevance information in a relevance feedback environment

Information Processing and Management: an International Journal
Evaluating the effectiveness of relevance feedback based on a user simulation model: effects of a user scenario on cumulated gain value

Information Retrieval
Personalized web exploration with task models

Proceedings of the 17th international conference on World Wide Web
A probabilistic ranking framework using unobservable binary events for video search

CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
A rank-aggregation approach to searching for optimal query-specific clusters

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Generation of Query-Biased Concepts Using Content and Structure for Query Reformulation

NLDB '08 Proceedings of the 13th international conference on Natural Language and Information Systems: Applications of Natural Language to Information Systems
Exploring criteria for successful query expansion in the genomic domain

Information Retrieval
Clusters, language models, and ad hoc information retrieval

ACM Transactions on Information Systems (TOIS)
Implicit relevance feedback for context-aware information retrieval in UbiLearning environments

Proceedings of the 2009 ACM symposium on Applied Computing
Cost and benefit analysis of mediated enterprise search

Proceedings of the 9th ACM/IEEE-CS joint conference on Digital libraries
Re-ranking search results using language models of query-specific clusters

Information Retrieval
Dynamically constructing user profiles with similarity-based online incremental clustering

International Journal of Advanced Intelligence Paradigms
A comparison of query and term suggestion features for interactive searching

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Ordinal Regression Based Model for Personalized Information Retrieval

ICTIR '09 Proceedings of the 2nd International Conference on Theory of Information Retrieval: Advances in Information Retrieval Theory
Mining meaning from Wikipedia

International Journal of Human-Computer Studies
CoSeNa: a context-based search and navigation system

Proceedings of the International Conference on Management of Emergent Digital EcoSystems
Exploring path query results through relevance feedback

Proceedings of the 18th ACM conference on Information and knowledge management
Interactive relevance feedback with graded relevance and sentence extraction: simulated user experiments

Proceedings of the 18th ACM conference on Information and knowledge management
Image retrieval with automatic query expansion based on local analysis in a semantical concept feature space

Proceedings of the ACM International Conference on Image and Video Retrieval
Content-based attention ranking using visual and contextual attention model for baseball videos

IEEE Transactions on Multimedia - Special issue on integration of context and content
Towards a model of implicit feedback for Web search

Journal of the American Society for Information Science and Technology
Query Reformulation Based on Relevance Feedback

FQAS '09 Proceedings of the 8th International Conference on Flexible Query Answering Systems
Content-Oriented Relevance Feedback in XML-IR Using the Garnata Information Retrieval System

FQAS '09 Proceedings of the 8th International Conference on Flexible Query Answering Systems
Implicit human-centered tagging

ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Query reformulation using automatically generated query concepts from a document space

Information Processing and Management: an International Journal
Feedback-driven result ranking and query refinement for exploring semi-structured data collections

Proceedings of the 13th International Conference on Extending Database Technology
Feedback-based annotation, selection and refinement of schema mappings for dataspaces

Proceedings of the 13th International Conference on Extending Database Technology
Relevance feedback using weight propagation compared with information-theoretic query expansion

ECIR'07 Proceedings of the 29th European conference on IR research
A new framework for taxonomy discovery from text

PAKDD'08 Proceedings of the 12th Pacific-Asia conference on Advances in knowledge discovery and data mining
Emerging topic detection on Twitter based on temporal and social terms evaluation

Proceedings of the Tenth International Workshop on Multimedia Data Mining
PANORAMA: A 3D Shape Descriptor Based on Panoramic Views for Unsupervised 3D Object Retrieval

International Journal of Computer Vision
Inferring document utility via a decision-making based retrieval model

International Journal of Knowledge-based and Intelligent Engineering Systems
PageRank without hyperlinks: Structural reranking using links induced by language models

ACM Transactions on Information Systems (TOIS)
On identifying representative relevant documents

CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
i-TEL-u: a query suggestion tool for integrating heterogeneous contexts in a digital library

ECDL'10 Proceedings of the 14th European conference on Research and advanced technology for digital libraries
Dynamic ranked retrieval

Proceedings of the fourth ACM international conference on Web search and data mining
Towards a collection-based results diversification

RIAO '10 Adaptivity, Personalization and Fusion of Heterogeneous Information
Utilizing user-input contextual terms for query disambiguation

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Concept-Based Information Retrieval Using Explicit Semantic Analysis

ACM Transactions on Information Systems (TOIS)
Interactive event search through transfer learning

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
Retrieval from software libraries for bug localization: a comparative study of generic and composite text models

Proceedings of the 8th Working Conference on Mining Software Repositories
Personalisation in the wild: providing personalisation across semantic, social and open-web resources

Proceedings of the 22nd ACM conference on Hypertext and hypermedia
ReFER: effective relevance feedback for entity ranking

ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
Simulating simple and fallible relevance feedback

ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
Using pseudo feedback to improve cross-lingual ontology mapping

ESWC'11 Proceedings of the 8th extended semantic web conference on The semantic web: research and applications - Volume Part I
A query expansion framework in image retrieval domain based on local and global analysis

Information Processing and Management: an International Journal
Promoting divergent terms in the estimation of relevance models

ICTIR'11 Proceedings of the Third international conference on Advances in information retrieval theory
Negation for document re-ranking in ad-hoc retrieval

ICTIR'11 Proceedings of the Third international conference on Advances in information retrieval theory
Combining strategies for XML retrieval

INEX'10 Proceedings of the 9th international conference on Initiative for the evaluation of XML retrieval: comparative evaluation of focused retrieval
Interactive sense feedback for difficult queries

Proceedings of the 20th ACM international conference on Information and knowledge management
A Survey of Automatic Query Expansion in Information Retrieval

ACM Computing Surveys (CSUR)
Relevance feedback for structural query expansion

INEX'05 Proceedings of the 4th international conference on Initiative for the Evaluation of XML Retrieval
Editorial: Narrative-based taxonomy distillation for effective indexing of text collections

Data & Knowledge Engineering
Feedback-Driven structural query expansion for ranked retrieval of XML data

EDBT'06 Proceedings of the 10th international conference on Advances in Database Technology
Component ranking and automatic query refinement for XML retrieval

INEX'04 Proceedings of the Third international conference on Initiative for the Evaluation of XML Retrieval
Relevance feedback for XML retrieval

INEX'04 Proceedings of the Third international conference on Initiative for the Evaluation of XML Retrieval
Using segmented objects in ostensive video shot retrieval

AMR'05 Proceedings of the Third international conference on Adaptive Multimedia Retrieval: user, context, and feedback
The effects of relevance feedback quality and quantity in interactive relevance feedback: a simulation based on user modeling

ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
Structural feedback for keyword-based XML retrieval

ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
A sensemaking environment for literature study

CHI '12 Extended Abstracts on Human Factors in Computing Systems
What's trending?: mining topical trends in UGC systems with YouTube as a case study

Proceedings of the Eleventh International Workshop on Multimedia Data Mining
Natural language technology and query expansion: issues, state-of-the-art and perspectives

Journal of Intelligent Information Systems
Generating queries from user-selected text

Proceedings of the 4th Information Interaction in Context Symposium
COPE: interactive image retrieval using conversational recommendation

BCS-HCI '12 Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers
A configurable translation-based cross-lingual ontology mapping system to adjust mapping outcomes

Web Semantics: Science, Services and Agents on the World Wide Web
Query expansion powered by wikipedia hyperlinks

AI'12 Proceedings of the 25th Australasian joint conference on Advances in Artificial Intelligence
Incrementally improving dataspaces based on user feedback

Information Systems
A survey of faceted search

Journal of Web Engineering
Personalized emerging topic detection based on a term aging model

ACM Transactions on Intelligent Systems and Technology (TIST) - Special Section on Intelligent Mobile Knowledge Discovery and Management Systems and Special Issue on Social Web Mining
Effectiveness of search result classification based on relevance feedback

Journal of Information Science
Personalised Information Retrieval: survey and classification

User Modeling and User-Adapted Interaction
Dynamic maps for exploring and browsing shapes

SGP '13 Proceedings of the Eleventh Eurographics/ACMSIGGRAPH Symposium on Geometry Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Users of online search engines often find it difficult to express their need for information in the form of a query. However, if the user can identify examples of the kind of documents they require then they can employ a technique known as relevance feedback. Relevance feedback covers a range of techniques intended to improve a user's query and facilitate retrieval of information relevant to a user's information need. In this paper we survey relevance feedback techniques. We study both automatic techniques, in which the system modifies the user's query, and interactive techniques, in which the user has control over query modification. We also consider specific interfaces to relevance feedback systems and characteristics of searchers that can affect the use and success of relevance feedback systems.