Managing the knowledge creation process of large-scale evaluation campaigns

Authors:
Marco Dussin;Nicola Ferro
Affiliations:
University of Padua, Italy;University of Padua, Italy
Venue:
ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
Year:
2009

Citing 9
Cited 1

The Cranfield tests on index language devices

Readings in information retrieval
TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)

TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)
The wisdom hierarchy: representations of the DIKW hierarchy

Journal of Information Science
A formal model of annotations of digital content

ACM Transactions on Information Systems (TOIS)
Evaluation of digital libraries

International Journal on Digital Libraries
The role of the dikw hierarchy in the design of a digital library system for the scientific data of large-scale evaluation campaigns

Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries
The Future of Large-Scale Evaluation Campaigns for Information Retrieval in Europe

ECDL '07 Proceedings of the 11th European conference on Research and Advanced Technology for Digital Libraries
The knowledge pyramid: a critique of the DIKW hierarchy

Journal of Information Science
DIRECT: a system for evaluating information access components of digital libraries

ECDL'05 Proceedings of the 9th European conference on Research and Advanced Technology for Digital Libraries

DIRECTions: design and specification of an IR evaluation infrastructure

CLEF'12 Proceedings of the Third international conference on Information Access Evaluation: multilinguality, multimodality, and visual analytics

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper discusses the evolution of large-scale evaluation campaigns and the corresponding evaluation infrastructures needed to carry them out. We present the next challenges for these initiatives and show how digital library systems can play a relevant role in supporting the research conducted in these fora by acting as virtual research environments.