A distributed, fault-tolerant multi-agent web mining system for scalable web search

  • Authors:
  • N. P. Gopalan;J. Akilandeswari

  • Affiliations:
  • Department of Computer Science and Engineering, National Institute of Technology, Tiruchirappalli, Tamil Nadu, India;Department of Computer Science and Engineering, National Institute of Technology, Tiruchirappalli, Tamil Nadu, India

  • Venue:
  • AIC'05 Proceedings of the 5th WSEAS International Conference on Applied Informatics and Communications
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

With the increasing amount of information available over Internet, there is a need for a more specialized search tool to retrieve quality web pages relevant to the topic of search. The traditional search engines index only the static collections of web and there is a large gap between the current contents of web and the image of WWW stored in search engine databases. An attempt has been made to reduce this shortcoming by mining the web online at query time with adaptive learning multi-agents. The proposed system is scalable in the sense that it downloads several hundreds of relevant web documents per second and is resilient against the system crashes with graceful degradation. It is found that the present technique, as a complementary tool to any of the existing search engines provides a better performance with respect to recency, recall, precision, and coverage.