Compressed string dictionaries

  • Authors:
  • Nieves R. Brisaboa;Rodrigo Cánovas;Francisco Claude;Miguel A. Martínez-Prieto;Gonzalo Navarro

  • Affiliations:
  • Database Lab, Universidade da Coruña, Spain;Department of Computer Science, University of Chile, Chile;School of Computer Science, University of Waterloo, Canada;Department of Computer Science, University of Chile, Chile and Department of Computer Science, Universidad de Valladolid, Spain;Department of Computer Science, University of Chile, Chile

  • Venue:
  • SEA'11 Proceedings of the 10th international conference on Experimental algorithms
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The problem of storing a set of strings - a string dictionary - in compact form appears naturally in many cases. While classically it has represented a small part of the whole data to be processed (e.g., for Natural Language processing or for indexing text collections), recent applications inWeb engines, RDF graphs, Bioinformatics, and many others, handle very large string dictionaries, whose size is a significant fraction of the whole data. Thus efficient approaches to compress them are necessary. In this paper we empirically compare time and space performance of some existing alternatives, as well as new ones we propose. We show that space reductions of up to 20% of the original size of the strings is possible while supporting dictionary searches within a few microseconds, and up to 10% within a few tens or hundreds of microseconds.