The Legion vision of a worldwide virtual computer
Communications of the ACM
File server scaling with network-attached secure disks
SIGMETRICS '97 Proceedings of the 1997 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
The grid: blueprint for a new computing infrastructure
The grid: blueprint for a new computing infrastructure
A distributed catalog for heterogeneous distributed database resources
PDIS '91 Proceedings of the first international conference on Parallel and distributed information systems
The SDSC storage resource broker
CASCON '98 Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research
Distributed Database Management Systems and the Data Grid
MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
Active Disk File System: A Distributed, Scalable File System
MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
File and Object Replication in Data Grids
HPDC '01 Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing
Grid Data Mirroring Package (GDMP)
Scientific Programming
A VO-based two-swtage replica replacement algorithm
NPC'07 Proceedings of the 2007 IFIP international conference on Network and parallel computing
Design and evaluation of network-bandwidth-based parallel replication algorithm
ISPA'05 Proceedings of the Third international conference on Parallel and Distributed Processing and Applications
A prediction-based parallel replication algorithm in distributed storage system
GCC'05 Proceedings of the 4th international conference on Grid and Cooperative Computing
A proxy service for the xrootd data server
SAG'04 Proceedings of the First international conference on Scientific Applications of Grid Computing
| Hi-index | 0.00 |
Data distribution and replication in distributed systems require special purpose middleware tools for accessing replicated data. Data Grids, special forms of systems distributed over wide-area networks, need to handle data management issues like distribution and replication of large amounts of data in the Tera- and Petabyte scale. Replica catalogues are used for cataloguing and locating replicated files in distributed sites all around the globe. We present a novel and administratively scalable approach for distributing a replica catalogue and resolving file location information by using HTTP redirection. HTTP redirection servers managing local file catalogues allow for greater flexibility and local file management autonomy whereas a global replica catalogue provides the necessary mapping of logical files to individual sites. By distributing the catalogues a site can autonomously move files for load balancing within a site without notifying a global replica catalogue. Our approach scales well in terms of catalogue administration to a large number of sites and file entries and thus establishes a powerful middleware service. We present the design and implementation of our catalogue redirection servers and report on promising experimental results.