Evaluation and user preference study on spatial diversity

Authors:
Jiayu Tang;Mark Sanderson
Affiliations:
Department of Information Studies, University of Sheffield, UK;Department of Information Studies, University of Sheffield, UK
Venue:
ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
Year:
2010

Citing 10
Cited 9

The use of MMR, diversity-based reranking for reordering documents and producing summaries

Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval
Beyond independent relevance: methods and evaluation metrics for subtopic retrieval

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Improving web search results using affinity graph

Proceedings of the 28th annual international ACM SIGIR conference on Research and development in information retrieval
On GMAP: and other transformations

CIKM '06 Proceedings of the 15th ACM international conference on Information and knowledge management
Novelty and diversity in information retrieval evaluation

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Crowdsourcing for relevance evaluation

ACM SIGIR Forum
Generic and Spatial Approaches to Image Search Results Diversification

ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
Automatic Extraction of Useful Facet Hierarchies from Text Databases

ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
Jointly optimising relevance and diversity in image retrieval

Proceedings of the ACM International Conference on Image and Video Retrieval
Judging the spatial relevance of documents for GIR

ECIR'06 Proceedings of the 28th European conference on Advances in Information Retrieval

Spatial diversity, do users appreciate it?

Proceedings of the 6th Workshop on Geographic Information Retrieval
Design and implementation of relevance assessments using crowdsourcing

ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
Recent developments in information retrieval

ECIR'2010 Proceedings of the 32nd European conference on Advances in Information Retrieval
Top-k bounded diversification

SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
Phrase detectives: Utilizing collective intelligence for internet-scale language resource creation

ACM Transactions on Interactive Intelligent Systems (TiiS) - Special section on internet-scale human problem solving and regular papers
Implementing crowdsourcing-based relevance experimentation: an industrial perspective

Information Retrieval
Top-k diversity queries over bounded regions

ACM Transactions on Database Systems (TODS)
A learning approach to optimizing exploration---exploitation tradeoff in relevance feedback

Information Retrieval
Spatial search for K diverse-near neighbors

Proceedings of the 22nd ACM international conference on Conference on information & knowledge management

Quantified Score

Hi-index	0.00

Visualization

Abstract

Spatial diversity is a relatively new branch of research in the context of spatial information retrieval. Although the assumption that spatially diversified results may meet users’ needs better seems reasonable, there has been little hard evidence in the literature indicating so. In this paper, we will show the potentials of spatial diversity by not only the traditional evaluation metrics (precision and cluster recall), but also through a user preference study using Amazon Mechanical Turk. The encouraging results from the latter prove that users do have strong preference on spatially diversified results.