Improving Search Engines Performance on Multithreading Processors

  • Authors:
  • Carolina Bonacic;Carlos Garcia;Mauricio Marin;Manuel Prieto;Francisco Tirado;Cesar Vicente

  • Affiliations:
  • Depto. Arquitectura de Computadores y Automática, Universidad Complutense de Madrid,;Depto. Arquitectura de Computadores y Automática, Universidad Complutense de Madrid,;Yahoo! Research Latin America, Santiago of Chile,;Depto. Arquitectura de Computadores y Automática, Universidad Complutense de Madrid,;Depto. Arquitectura de Computadores y Automática, Universidad Complutense de Madrid,;Depto. Arquitectura de Computadores y Automática, Universidad Complutense de Madrid,

  • Venue:
  • High Performance Computing for Computational Science - VECPAR 2008
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we present strategies and experiments that show how to take advantage of the multi-threading parallelism available in Chip Multithreading (CMP) processors in the context of efficient query processing for search engines. We show that scalable performance can be achieved by letting the search engine go synchronous so that batches of queries can be processed concurrently in a simple but very efficient manner. Furthermore, our results indicate that the multithreading capabilities of modern CMP systems are not fully exploited when the search engine operates on a conventional asynchronous mode due to the moderate thread level parallelism that can be extracted from a single query.