An evaluation of fault-tolerant query processing for web search engines

  • Authors:
  • Carlos Gomez-Pantoja;Mauricio Marin;Veronica Gil-Costa;Carolina Bonacic

  • Affiliations:
  • Yahoo! Research Latin America, Santiago and DCC, University of Chile, Chile;Yahoo! Research Latin America, Santiago and DIINF, University of Santiago of Chile, Chile;Yahoo! Research Latin America, Santiago, Chile and CONICET, University of San Luis, Argentina;Yahoo! Research Latin America, Santiago, Chile

  • Venue:
  • Euro-Par'11 Proceedings of the 17th international conference on Parallel processing - Volume Part I
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

A number of strategies to perform parallel query processing in large scale Web search engines have been proposed in recent years. Their design assume that computers never fail. However, in actual data centers supporting Web search engines, individual cluster processors can enter or leave service dynamically due to transient and/or permanent faults. This paper studies the suitability of efficient query processing strategies under a standard setting where processor replication is used to improve query throughput and support fault-tolerance.