A hybrid cache and prefetch mechanism for scientific literature search engines

Authors:
Huajing Li;Wang-Chien Lee;Anand Sivasubramaniam;C. Lee Giles
Affiliations:
Department of Computer Science and Engineering, Pennsylvania State University, State College, PA;Department of Computer Science and Engineering, Pennsylvania State University, State College, PA;Department of Computer Science and Engineering, Pennsylvania State University, State College, PA;Department of Computer Science and Engineering and The School of Information Sciences and Technology, Pennsylvania State University, State College, PA
Venue:
ICWE'07 Proceedings of the 7th international conference on Web engineering
Year:
2007

Citing 13
Cited 3

Caching strategies to improve disk system performance

Computer
Interaction of query evaluation and buffer management for information retrieval

SIGMOD '98 Proceedings of the 1998 ACM SIGMOD international conference on Management of data
Indexing and retrieval of scientific literature

Proceedings of the eighth international conference on Information and knowledge management
Analysis of a very large web search engine query log

ACM SIGIR Forum
Rank-preserving two-level caching for scalable search engines

Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval
Digital Libraries and Autonomous Citation Indexing

Computer
My Cache or Yours? Making Storage More Exclusive

ATEC '02 Proceedings of the General Track of the annual conference on USENIX Annual Technical Conference
Predictive caching and prefetching of query results in search engines

WWW '03 Proceedings of the 12th international conference on World Wide Web
Three-level caching for efficient query processing in large Web search engines

WWW '05 Proceedings of the 14th international conference on World Wide Web
Optimizing result prefetching in web search engines with segmented indices

VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
A novel caching scheme for improving Internet-based mobile ad hoc networks performance

Ad Hoc Networks
Caching complementary space for location-based services

EDBT'06 Proceedings of the 10th international conference on Advances in Database Technology
On caching search engine query results

Computer Communications

Prefetching query results and its impact on search engines

SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Online result cache invalidation for real-time web search

SIGIR '12 Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval
Cache-Based Query Processing for Search Engines

ACM Transactions on the Web (TWEB)

Quantified Score

Hi-index	0.00

Visualization

Abstract

CiteSeer, a scientific literature search engine that focuses on documents in the computer science and information science domains, suffers from scalability issue on the number of requests and the size of indexed documents, which increased dramatically over the years. CiteSeerχ is an effort to re-architect the search engine. In this paper, we present our initial design of a framework for caching query results, indices, and documents. This design is based on analysis of logged workload in CiteSeer. Our experiments based on mock client requests that simulate actual user behaviors confirm that our approach works well in enhancing system performances.