Distributed Data Access and Resource Management in the D0 SAM System

Authors:
R. Pordes;J. Trumbo;S. Veseli;M. Vranicar;H. Schellman
Affiliations:
-;-;-;-;-
Venue:
HPDC '01 Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing
Year:
2001

Citing 0
Cited 4

Predicting the Performance of Wide Area Data Transfers

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Predicting Sporadic Grid Data Transfers

HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
File-based replica management

Future Generation Computer Systems
File-based replica management

Future Generation Computer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Abstract: SAM (Sequential Access through Meta-data) is the data access and job management system for the D0 high energy physics experiment at Fermilab. The SAM system is being developed and used to handle the Petabyte-scale experiment data, accessed by hundreds of D0 collaborators scattered around the world. In this paper, we present solutions to some of the distributed data processing problems from the perspective of real experience dealing with mission-critical data. We concentrate on the distributed disk caching, resource management and job control. The system has elements of the Grid Computing and has features applicable to data-intensive computing in general.