Representing document lengths with identifiers

  • Authors:
  • Raffaele Perego;Fabrizio Silvestri;Nicola Tonellotto

  • Affiliations:
  • ISTI, National Research Council of Italy, Pisa, Italy;ISTI, National Research Council of Italy, Pisa, Italy;ISTI, National Research Council of Italy, Pisa, Italy

  • Venue:
  • ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The length of each indexed document is needed by most common text retrieval scoring functions to rank it with respect to the current query. For efficiency purposes information retrieval systems maintain this information in the main memory. This paper proposes a novel strategy to encode the length of each document directly in the document identifier, thus reducing main memory demand. The technique is based on a simple document identifier assignment method and a function allowing the approximate length of each indexed document to be computed analytically.