Annotations and digital libraries: designing adequate test-beds

Authors:
Maristella Agosti;Tullio Coppotelli;Nicola Ferro;Luca Pretto
Affiliations:
Department of Information Engineering, University of Padua, Italy;Department of Information Engineering, University of Padua, Italy;Department of Information Engineering, University of Padua, Italy;Department of Information Engineering, University of Padua, Italy
Venue:
ICADL'07 Proceedings of the 10th international conference on Asian digital libraries: looking back 10 years and forging new frontiers
Year:
2007

Citing 7
Cited 1

From reading to retrieval: freeform ink annotations as queries

Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval
Forming test collections with no system pooling

Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval
TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)

TREC: Experiment and Evaluation in Information Retrieval (Digital Libraries and Electronic Publishing)
Minimal test collections for retrieval evaluation

SIGIR '06 Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval
A formal model of annotations of digital content

ACM Transactions on Information Systems (TOIS)
An approach for the construction of an experimental test collection to evaluate search systems that exploit annotations

DELOS'07 Proceedings of the 1st international conference on Digital libraries: research and development
Annotations as context for searching documents

CoLIS'05 Proceedings of the 5th international conference on Context: conceptions of Library and Information Sciences

An approach for the construction of an experimental test collection to evaluate search systems that exploit annotations

DELOS'07 Proceedings of the 1st international conference on Digital libraries: research and development

Quantified Score

Hi-index	0.00

Visualization

Abstract

The increasing number of users and the diffusion of Digital Libraries (DLs) has increased the demand for newer and improved systems to give better assistance to the user during the search of resources in collections managed by Digital Library Systems (DLSs). In this perspective, the annotations made on documents offer an interesting possibility for improving both the user experience of the DLS and the retrieval performance of the system itself. However, while different approaches based on annotations have been proposed, they still lack a full experimental evaluation, mainly because an experimental collection with annotation is missing. Therefore, this paper addresses the problem of setting an adequate experimental test-bed for DL search algorithms which exploit annotations, and discusses a flexible strategy for creating test collections with annotated documents.