Parallel crawler architecture and web page change detection
WSEAS Transactions on Computers
Reliability of a distributed search engine for fresh information retrieval in large-scale intranet
ISPA'03 Proceedings of the 2003 international conference on Parallel and distributed processing and applications
| Hi-index | 0.00 |
Abstract: Information Retrieval is frequently used for Internet. However, we face the problem that the update intervals of conventional search engines are too long. It is difficult for conventional search engines to make their intervals short because they are based on centralized architecture. So, we proposed Cooperative Search Engine (CSE), which is based on distributed architecture. CSE can realize to shorten the update interval. In CSE, a large search engine is constructed with multiple local meta search engines that cooperate with each other. CSE can do correct ranking in distributed fashion because each local Meta search engine hides the difference between its local search engine and the others. In this paper, we describe about the design and experimental evaluations of CSE.