Ranked document retrieval in (almost) no space

  • Authors:
  • Nieves R. Brisaboa;Ana Cerdeira-Pena;Gonzalo Navarro;Óscar Pedreira

  • Affiliations:
  • Database Lab., Univ. of A Coruña, Spain;Database Lab., Univ. of A Coruña, Spain;Dept. of Computer Science, Univ. of Chile, Chile;Database Lab., Univ. of A Coruña, Spain

  • Venue:
  • SPIRE'12 Proceedings of the 19th international conference on String Processing and Information Retrieval
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Ranked document retrieval is a fundamental task in search engines. Such queries are solved with inverted indexes that require additional 45%-80% of the compressed text space, and take tens to hundreds of microseconds per query. In this paper we show how ranked document retrieval queries can be solved within tens of milliseconds using essentially no extra space over an in-memory compressed representation of the document collection. More precisely, we enhance wavelet trees on bytecodes (WTBCs), a data structure that rearranges the bytes of the compressed collection, so that they support ranked conjunctive and disjunctive queries, using just 6%---18% of the compressed text space.