File-based replica management

Authors:
Peter Kunszt;Erwin Laure;Heinz Stockinger;Kurt Stockinger
Affiliations:
CERN, European Organization for Nuclear Research, CH-1211 Geneva 23, Switzerland;CERN, European Organization for Nuclear Research, CH-1211 Geneva 23, Switzerland;CERN, European Organization for Nuclear Research, CH-1211 Geneva 23, Switzerland;Lawrence Berkeley National Laboratory, 1 Cyclotron Road, Berkeley, CA 94720, USA
Venue:
Future Generation Computer Systems
Year:
2005

Citing 10
Cited 12

The network weather service: a distributed resource performance forecasting service for metacomputing

Future Generation Computer Systems - Special issue on metacomputing
High-performance remote access to climate simulation data: a challenge problem for data grid technologies

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Grid Services for Distributed System Integration

Computer
Reliable File Transfer in Grid Environments

LCN '02 Proceedings of the 27th Annual IEEE Conference on Local Computer Networks
Giggle: a framework for constructing scalable replica location services

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
The SDSC storage resource broker

CASCON '98 Proceedings of the 1998 conference of the Centre for Advanced Studies on Collaborative research
Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing

MSS '01 Proceedings of the Eighteenth IEEE Symposium on Mass Storage Systems and Technologies
Distributed Data Access and Resource Management in the D0 SAM System

HPDC '01 Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing
Access Cost Estimation for Unified Grid Storage Systems

GRID '03 Proceedings of the 4th International Workshop on Grid Computing
Grid Data Mirroring Package (GDMP)

Scientific Programming

Building Hierarchical Grid Storage Using the Gfarm Global File System and the JuxMem Grid Data-Sharing Service

Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Distributed Management of Massive Data: An Efficient Fine-Grain Data Access Scheme

High Performance Computing for Computational Science - VECPAR 2008
Grid services for HSM systems monitoring

PPAM'07 Proceedings of the 7th international conference on Parallel processing and applied mathematics
Editorial: Special section: Data management for eScience

Future Generation Computer Systems
PHFS: A dynamic replication method, to decrease access latency in the multi-tier data grid

Future Generation Computer Systems
BlobSeer: Next-generation data management for large scale infrastructures

Journal of Parallel and Distributed Computing
Design of file size and type of access based replication algorithm for data grid

Proceedings of the International Conference & Workshop on Emerging Trends in Technology
Managing data using neighbor replication on triangular-grid structure

ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part IV
RRS: replica registration service for data grids

DMG 2005 Proceedings of the First VLDB conference on Data Management in Grids
An autonomic framework for enhancing the quality of data grid services

Future Generation Computer Systems
PFRF: An adaptive data replication algorithm based on star-topology data grids

Future Generation Computer Systems
High performance reliable file transfers using automatic many-to-many parallelization

Euro-Par'12 Proceedings of the 18th international conference on Parallel processing workshops

Quantified Score

Hi-index	0.00

Visualization

Abstract

Data replication is one of the best known strategies to achieve high levels of availability and fault tolerance, as well as minimal access times for large, distributed user communities using a world-wide Data Grid. In certain scientific application domains, the data volume can reach the order of several petabytes; in these domains, data replication and access optimization play an important role in the manageability and usability of the Grid. In this paper, we present the design and implementation of a replica management Grid middleware that was developed within the EDG project [European DataGrid Project (EDG), http://www.eu-egee.org] and is designed to be extensible so that user communities can adjust its detailed behavior according to their QoS requirements.