A bridging model for parallel computation
Communications of the ACM
Filtered document retrieval with frequency-sorted indexes
Journal of the American Society for Information Science
ACM Transactions on Internet Technology (TOIT)
Inverted files for text search engines
ACM Computing Surveys (CSUR)
A pipelined architecture for distributed text query evaluation
Information Retrieval
High-performance distributed inverted files
Proceedings of the sixteenth ACM conference on Conference on information and knowledge management
A Search Engine Accepting On-Line Updates
Euro-Par '07 Proceedings of the 13th European international conference on Parallel Processing
(Sync|Async)+ MPI search engines
PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Building efficient multi-threaded search nodes
CIKM '10 Proceedings of the 19th ACM international conference on Information and knowledge management
An evaluation of fault-tolerant query processing for web search engines
Euro-Par'11 Proceedings of the 17th international conference on Parallel processing - Volume Part I
| Hi-index | 0.00 |
With the emergence of multi-core CPU (or Chip-level MultiProcessor -CMP-), it is essential to develop techniques that capitalize on CMP's advantages to speed up very demanding applications of parallel computing such as Web search engines. In particular, for this application and given the huge amount of computational resources deployed at data centers, it is of paramount importance to come out with strategies able to get the best performance from hardware. This is specially critical when we consider how we organize hardware to cope with sustained periods of very high traffic of user queries. In this paper, we propose an hybrid technique based on MPIand OpenMPwhich has been devised to take advantage of the multithreading facilities provided by CMP nodes for search engines under high query traffic.