Reliability of a distributed search engine for fresh information retrieval in large-scale intranet

Authors:
Nobuyoshi Sato;Minoru Udagawa;Minoru Uehara;Yoshifumi Sakai
Affiliations:
Department of Information and Computer Sciences, Toyo University, Kawagoe City, Saitama, Japan;Department of Information and Computer Sciences, Toyo University, Kawagoe City, Saitama, Japan;Department of Information and Computer Sciences, Toyo University, Kawagoe City, Saitama, Japan;Graduate School of Agricultural Science, Tohoku University, Sendai City, Miyagi, Japan
Venue:
ISPA'03 Proceedings of the 2003 international conference on Parallel and distributed processing and applications
Year:
2003

Citing 8
Cited 0

The process group approach to reliable distributed computing

Communications of the ACM
Impossibility of distributed consensus with one faulty process

Journal of the ACM (JACM)
Protecting Free Expression Online with Freenet

IEEE Internet Computing
Fresh Information Retrieval Using Cooperative Meta Search Engines

ICOIN '02 Revised Papers from the International Conference on Information Networking, Wireless Communications Technologies and Network Applications-Part II
Persistent Cache in Cooperative Search Engine

ICDCSW '02 Proceedings of the 22nd International Conference on Distributed Computing Systems
Distributed Information Retrieval by Using Cooperative Meta Search Engines

ICDCSW '01 Proceedings of the 21st International Conference on Distributed Computing Systems
Randomized Byzantine Agreement

IEEE Transactions on Software Engineering
Fault tolerant computing in computational field model

ECBS'97 Proceedings of the 1997 international conference on Engineering of computer-based systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have developed distributed search engine, called Cooperative Search Engine (CSE), in order to retrieve fresh information. In CSE, a local search engine located in each Web server makes an index of local pages. And, a meta search server integrates these local search engines in order to realize a global search engine. However, in such a way, the communication delay occurs at retrieval time. So, it is thought to be difficult to search fast. However, we have developed several speedup techniques in order to realize real time retrieval. By the way, distributed search engines such as CSE are essentially fault tolerant. However, the meta server is single point of failure in CSE. So, we propose redundancy of meta search servers in order to increase availability of CSE. In this paper, we describe reliability of CSE and their evaluations.