Report on the SIGIR 2010 workshop on the simulation of interaction

Authors:
Leif Azzopardi;Kalervo Järvelin;Jaap Kamps;Mark D. Smucker
Affiliations:
University of Glasgow, Scotland;University of Tampere, Finland;University of Amsterdam, The Netherlands;University of Waterloo, Canada
Venue:
ACM SIGIR Forum
Year:
2011

Citing 4
Cited 8

Relevance feedback revisited

SIGIR '92 Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval
Problems in the simulation of bibliographic retrieval systems

SIGIR '80 Proceedings of the 3rd annual ACM conference on Research and development in information retrieval
Evaluating implicit feedback models using searcher simulations

ACM Transactions on Information Systems (TOIS)
Evaluating the effectiveness of relevance feedback based on a user simulation model: effects of a user scenario on cumulated gain value

Information Retrieval

Simulating simple and fallible relevance feedback

ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
The economics in interactive information retrieval

Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Towards a living lab for information retrieval research and development: a proposal for a living lab for product search tasks

CLEF'11 Proceedings of the Second international conference on Multilingual and multimodal information access evaluation
Time-based calibration of effectiveness measures

SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Modeling user variance in time-biased gain

Proceedings of the Symposium on Human-Computer Interaction and Information Retrieval
Modeling behavioral factors ininteractive information retrieval

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management
Report on the SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation (MUBE 2013)

ACM SIGIR Forum
The neglected user in music information retrieval research

Journal of Intelligent Information Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

All search in the real-world is inherently interactive. Information retrieval (IR) has a firm tradition of using simulation to evaluate IR systems as embodied by the Cranfield paradigm. However, to a large extent, such system evaluations ignore user interaction. Simulations provide a way to go beyond this limitation. With an increasing number of researchers using simulation to evaluate interactive IR systems, it is now timely to discuss, develop and advance this powerful methodology within the field of IR. During the SimInt 2010 workshop around 40 participants discussed and presented their views on the simulation of interaction. The main conclusion and general consensus was that simulation offers great potential for the field of IR; and that simulations of user interaction can make explicit the user and the user interface while maintaining the advantages of the Cranfield paradigm.