Advantages of query biased summaries in information retrieval
Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Real life, real users, and real needs: a study and analysis of user queries on the web
Information Processing and Management: an International Journal
Applying summarization techniques for term selection in relevance feedback
Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Liberal relevance criteria of TREC -: counting on negligible documents?
SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Incorporating user search behavior into relevance feedback
Journal of the American Society for Information Science and Technology
A survey on the use of relevance feedback for information access systems
The Knowledge Engineering Review
The influence of relevance levels on the effectiveness of interactive information retrieval
Journal of the American Society for Information Science and Technology
Identifying clusters of user behavior in intranet search engine log files
Journal of the American Society for Information Science and Technology
Synchronous Collaborative Information Retrieval: Techniques and Evaluation
ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
Including summaries in system evaluation
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Proceedings of the 18th ACM conference on Information and knowledge management
ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval
An extensible personal photograph collection for graded relevance assessments and user simulation
Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
User-Oriented evaluation in IR
PROMISE'12 Proceedings of the 2012 international conference on Information Retrieval Meets Information Visualization
Modeling behavioral factors ininteractive information retrieval
Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Effectiveness of search result classification based on relevance feedback
Journal of Information Science
Hi-index | 0.00 |
Much of the research in relevance feedback (RF) has been performed under laboratory conditions using test collections and either test persons or simple simulation. These studies have given mixed results. The design of the present study is unique. First, the initial queries are realistically short queries generated by real end-users. Second, we perform a user simulation with several RF scenarios. Third, we simulate human fallibility in providing RF, i.e., incorrectness in feedback. Fourth, we employ graded relevance assessments in the evaluation of the retrieval results. The research question is: how does RF affect IR performance when initial queries are short and feedback is fallible? Our findings indicate that very fallible feedback is no different from pseudorelevance feedback (PRF) and not effective on short initial queries. However, RF with empirically observed fallibility is as effective as correct RF and able to improve the performance of short initial queries.