Research note: Design and analysis of distributed object collection for web indexing

Authors:
J. S. Jin;R. Kurniawati
Affiliations:
School of Computer Science and Engineering, University of New South Wales, Sydney 2052, Australia;School of Computer Science and Engineering, University of New South Wales, Sydney 2052, Australia
Venue:
Computer Communications
Year:
2000

Citing 5
Cited 1

Scalable Internet resource discovery: research problems and approaches

Communications of the ACM
Measuring the Web

Proceedings of the fifth international World Wide Web conference on Computer networks and ISDN systems
Modeling the performance of HTTP over several transport protocols

IEEE/ACM Transactions on Networking (TON)
A generalized content-based image retrieval system

SAC '98 Proceedings of the 1998 ACM symposium on Applied Computing
ImageRover: A Content-Based Image Browser for the World Wide Web

CAIVL '97 Proceedings of the 1997 Workshop on Content-Based Access of Image and Video Libraries (CBAIVL '97)

Implementation of an on-site web multimedia collector

Computer Communications

Quantified Score

Hi-index	0.24

Visualization

Abstract

We propose a scheme for mobile and distributed objects collection over the World Wide Web. Using the approach, we can deploy a collector easily on the site being indexed. This and the availability of Java virtual machines virtually everywhere make finer grained task distribution possible compared to other approaches. We then develop a mathematical model for data transfer time using HTTP. We conclude that the proposed collector will do better in terms of total transfer time compared to a centralized collector, provided that we have a reasonable compression ratio (less than 80%) and the round-trip time is relatively big (above 100ms).