What Else Is There? Search Diversity Examined

Authors:
Mark Sanderson;Jiayu Tang;Thomas Arni;Paul Clough
Affiliations:
Dept. of Information Studies, University of Sheffield, Regent Court, Sheffield, UK S1 4DP;Dept. of Information Studies, University of Sheffield, Regent Court, Sheffield, UK S1 4DP;Dept. of Information Studies, University of Sheffield, Regent Court, Sheffield, UK S1 4DP;Dept. of Information Studies, University of Sheffield, Regent Court, Sheffield, UK S1 4DP
Venue:
ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
Year:
2009

Citing 11
Cited 4

The use of MMR, diversity-based reranking for reordering documents and producing summaries

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Beyond independent relevance: methods and evaluation metrics for subtopic retrieval

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Less is more: probabilistic models for retrieving fewer relevant documents

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
Diversifying the image retrieval results

MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Ambiguous requests: implications for retrieval tests, systems and theories

ACM SIGIR Forum
Ambiguous queries: test collections need more sense

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Novelty and diversity in information retrieval evaluation

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Overview of the ImageCLEFphoto 2007 Photographic Retrieval Task

Advances in Multilingual and Multimodal Information Retrieval
Overview of the ImageCLEFphoto 2008 photographic retrieval task

CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
Increasing precision and diversity in photo retrieval by result fusion

CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
Overview of the ImageCLEF 2006 photographic retrieval and object annotation tasks

CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval

A Task-Based Evaluation of an Aggregated Search Interface

SPIRE '09 Proceedings of the 16th International Symposium on String Processing and Information Retrieval
Diversifying Product Review Rankings: Getting the Full Picture

WI-IAT '11 Proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
Finding representative and diverse community contributed images to create visual summaries of geographic areas

MM '11 Proceedings of the 19th ACM international conference on Multimedia
A learning approach to optimizing exploration---exploitation tradeoff in relevance feedback

Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a study on diversity in image search results. One of the first test collections explicitly built to study diversity --- the ImageCLEFPhoto 2008 collection --- was used in an evaluation exercise in the summer of 2008. Analyzing 200 of the runs submitted by 24 research groups enabled the relationship between precision and result diversity to be studied. In addition, the level of diversity present in search results produced by retrieval systems built without explicit support for diversity was computed. The remaining potential to improve on diversity was calculated and finally, a significant preference by users for diverse search results was shown.