Report on the SIGIR 2009 workshop on the future of IR evaluation

Authors:
Jaap Kamps;Shlomo Geva;Carol Peters;Tetsuya Sakai;Andrew Trotman;Ellen Voorhees
Affiliations:
University of Amsterdam, The Netherlands & INEX;QUT, Australia & INEX;ISTI-CNR, Italy & CLEF;Microsoft Research Asia, China & NTCIR;University of Otago, New Zealand & INEX;NIST, USA & TREC/TAC
Venue:
ACM SIGIR Forum
Year:
2009

Citing 3
Cited 4

What's the value of TREC: is there a gap to jump or a chasm to bridge?

ACM SIGIR Forum
Meeting of the MINDS: an information retrieval research agenda

ACM SIGIR Forum
Evaluation Challenges and Directions for Information-Seeking Support Systems

Computer

Crowdsourcing for book search evaluation: impact of hit design on comparative system ranking

Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
A tool for comparative IR evaluation on component level

Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
Towards a living lab for information retrieval research and development: a proposal for a living lab for product search tasks

CLEF'11 Proceedings of the Second international conference on Multilingual and multimodal information access evaluation
Fusing different information retrieval systems according to query-topics: a study based on correlation in information retrieval systems and TREC topics

Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

On July 23, 2009 the SIGIR Workshop on the Future of IR Evaluation was held as part of SIGIR in Boston. The program consisted of four keynotes, a boaster and poster session with 20 accepted papers, four breakout groups, and a final panel discussion of the breakout group reports. This report outlines the events of the workshop and summarizes the major outcomes.