Distributed location aware web crawling

Authors:
Odysseas Papapetrou;George Samaras
Affiliations:
University of Cyprus, Nicosia, Cyprus;University of Cyprus, Nicosia, Cyprus
Venue:
Proceedings of the 13th international World Wide Web conference on Alternate track papers & posters
Year:
2004

Citing 0
Cited 3

Parallel crawler architecture and web page change detection

WSEAS Transactions on Computers
Topical web crawling using weighted anchor text and web page change detection techniques

WSEAS Transactions on Information Science and Applications
Estimating geographical position of nodes in the internet

IMSA '07 Proceedings of the Eleventh IASTED International Conference on Internet and Multimedia Systems and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

Distributed crawling has shown that it can overcome important limitations of the today's crawling paradigm. However, the optimal benefits of this approach are usually limited to the sites hosting the crawler. In this work, we propose a location-aware method, called IPMicra, that utilizes an IP address hierarchy, and allows crawling of links in a near optimal location aware manner.