Stress-testing general purpose digital library software

  • Authors:
  • David Bainbridge;Ian H. Witten;Stefan Boddie;John Thompson

  • Affiliations:
  • Department of Computer Science, University of Waikato, Hamilton, New Zealand;Department of Computer Science, University of Waikato, Hamilton, New Zealand;DL Consulting Ltd, Hamilton, NZ;DL Consulting Ltd, Hamilton, NZ

  • Venue:
  • ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

DSpace, Fedora, and Greenstone are three widely used open source digital library systems. In this paper we report on scalability tests performed on these tools by ourselves and others. These range from repositories populated with synthetically produced data to real world deployment with content measured in millions of items. A case study is presented that details how one of the systems performed when used to produce fully-searchable newspaper collections containing in excess of 20 GB of raw text (2 billion words, with 60 million unique terms), 50 GB of metadata, and 570 GB of images.