The CSIRO enterprise search test collection

Authors:
Peter Bailey;Nick Craswell;Ian Soboroff;Arjen P. de Vries
Affiliations:
CSIRO, Australia;Microsoft, UK;NIST;CWI, The Netherlands
Venue:
ACM SIGIR Forum
Year:
2007

Citing 1
Cited 11

TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)

TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)

A few examples go a long way: constructing query models from elaborate query formulations

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Relevance assessment: are judges exchangeable and does it matter

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Non-local evidence for expert finding

Proceedings of the 17th ACM conference on Information and knowledge management
A Vector Space Model for Ranking Entities and Its Application to Expert Search

ECIR '09 Proceedings of the 31th European Conference on IR Research on Advances in Information Retrieval
Aggregation Models for People Finding in Enterprise Corpora

KSEM '09 Proceedings of the 3rd International Conference on Knowledge Science, Engineering and Management
Contextual factors for finding similar experts

Journal of the American Society for Information Science and Technology
Topic Distillation with Query-Dependent Link Connections and Page Characteristics

ACM Transactions on the Web (TWEB)
Discriminative probabilistic models for expert search in heterogeneous information sources

Information Retrieval
The impact of author ranking in a library catalogue

Proceedings of the 4th ACM workshop on Online books, complementary social media and crowdsourcing
Using anchor text for homepage and topic distillation search tasks

Journal of the American Society for Information Science and Technology
Expertise Retrieval

Foundations and Trends in Information Retrieval

Quantified Score

Hi-index	0.00

Visualization

Abstract

This article describes a new TREC Enterprise Track search test collection -- CERC. The collection is designed to represent some real-world search activity within the enterprise, using as a specific example the Commonwealth Scientific and Industrial Research Organisation (CSIRO). It has a deep crawl of CSIRO's public-facing information, that is very similar to the crawl of a real-world search service provided by CSIRO. The search tasks are based on the activities of CSIRO Science Communicators, who are CSIRO employees that deal with public-facing information. Topics and judgments are tied to the Science Communicators in various ways, for example by involving them in the topic development process. The overall approach is to enhance the validity of the test collection as a model of enterprise search, by tying it to real-world examples.