CoBWeb A Crawler for the Brazilian Web

  • Authors:
  • Altigran S. da Silva;Eveline A. Veloso;Paulo B. Golghe;Berthier Ribeiro-Neto;Alberto H. F. Laender;Nivio Ziviani

  • Affiliations:
  • -;-;-;-;-;-

  • Venue:
  • SPIRE '99 Proceedings of the String Processing and Information Retrieval Symposium & International Workshop on Groupware
  • Year:
  • 1999

Quantified Score

Hi-index 0.00

Visualization

Abstract

One of the key components of current Web search engines is the document collector. This paper describes CoBWeb, an automatic document collector, whose architecture is distributed and highly scalable. CoBWeb aims at collecting large amounts of documents per time period, while observing operational and ethical limits in the crawling process. CoBWeb is part of the SIAM (Information Systems in Mobile Computing Environments) search engine which is being implemented to support the Brazilian Web. Thus, several results related to the Brazilian Web are presented.