Experiences in developing a node of an international computational physics data grid

Authors:
Paul Coddington;Gerson Galang;Waseem Kamleh;Derek Leinweber;Sam Moskwa;Julia Patterson;Qiang Wang;Andrew Wendelborn;Shunde Zhang;Qunfang Zhang
Affiliations:
University of Adelaide, Adelaide, SA, Australia;University of Adelaide, Adelaide, SA, Australia;University of Adelaide, Adelaide, SA, Australia;University of Adelaide, Adelaide, SA, Australia;University of Adelaide, Adelaide, SA, Australia;University of Adelaide, Adelaide, SA, Australia;University of Adelaide, Adelaide, SA, Australia;University of Adelaide, Adelaide, SA, Australia;University of Adelaide, Adelaide, SA, Australia;University of Adelaide, Adelaide, SA, Australia
Venue:
AusGrid '08 Proceedings of the sixth Australasian workshop on Grid computing and e-research - Volume 82
Year:
2008

Citing 4
Cited 0

Grid-Based Metadata Services

SSDBM '04 Proceedings of the 16th International Conference on Scientific and Statistical Database Management
Performance and Scalability of a Replica Location Service

HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
The design and implementation of Grid database services in OGSA-DAI: Research Articles

Concurrency and Computation: Practice & Experience - Grid Performance
A taxonomy of Data Grids for distributed data sharing, management, and processing

ACM Computing Surveys (CSUR)

Quantified Score

Hi-index	0.00

Visualization

Abstract

The International Lattice Data Grid (ILDG) is an international collaboration that creates standards to enable sharing of data produced by Lattice Quantum ChromoDynamics (QCD) simulations, which are very computationally expensive. In this paper we summarize our experiences in developing an Australian node of the ILDG, including implementing a program to generate metadata conforming to the QCDml XML schema developed by the ILDG, storing the metadata in an XML database, developing metadata catalog and file catalog services using standard web service interfaces, providing data download using an SRM interface, and implementing a web portal to the ILDG. One of the problems we encountered in this work was that existing metadata catalog software was not able to meet the requirements of this project. Although this work is specific to Lattice QCD data and the ILDG specifications, most of the main issues in developing the data grid node are quite general and not specific to the type of data.