Timestamp-based result cache invalidation for web search engines

  • Authors:

  • Sadiye Alici;Ismail Sengor Altingovde;Rifat Ozcan;Berkant Barla Cambazoglu;Özgür Ulusoy

  • Affiliations:

  • Bilkent University, Ankara, Turkey;L3S Research Center, Hannover, Germany;Bilkent University, Ankara, Turkey;Yahoo! Research, Barcelona, Spain;Bilkent University, Ankara, Turkey

  • Venue:
  • Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval
  • Year:
  • 2011

Quantified Score

Hi-index 0.01

Visualization

Abstract

The result cache is a vital component for efficiency of large-scale web search engines, and maintaining the freshness of cached query results is the current research challenge. As a remedy to this problem, our work proposes a new mechanism to identify queries whose cached results are stale. The basic idea behind our mechanism is to maintain and compare generation time of query results with update times of posting lists and documents to decide on staleness of query results. The proposed technique is evaluated using a Wikipedia document collection with real update information and a real-life query log. We show that our technique has good prediction accuracy, relative to a baseline based on the time-to-live mechanism. Moreover, it is easy to implement and incurs less processing overhead on the system relative to a recently proposed, more sophisticated invalidation mechanism.