Grid-Based Metadata Services

  • Authors:
  • Ewa Deelman;Gurmeet Singh;Malcolm P. Atkinson;Ann Chervenak;Neil P. Chue Hong;Carl Kesselman;Sonal Patil;Laura Pearlman;Mei-Hui Su

  • Affiliations:
  • University of Southern California;University of Southern California;University of Glasgow & Division of Informatics, University of Edinburgh;University of Southern California;Edinburgh Parallel Computing Centre, UK;University of Southern California;University of Southern California;University of Southern California;University of Southern California

  • Venue:
  • SSDBM '04 Proceedings of the 16th International Conference on Scientific and Statistical Database Management
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Data sets being managed in Grid environments today aregrowing at a rapid rate, expected to reach 100s of Petabytesin the near future. Managing such large data sets poseschallenges for efficient data access, data publication and datadiscovery. In this paper we focus on the data publication anddiscovery process through the use of descriptive metadata.This metadata describe the properties of individual data itemsand collections. We discuss issues of metadata services inservice rich environments, such as the Grid. We describe therequirements and the architecture for such services in thecontext of Grid and the available Grid services. We present adata model that can capture the complexity of the datapublication and discovery process. Based on that model weidentify a set of interfaces and operations that need to beprovided to support metadata management. We present aparticular implementation of a Grid metadata service, basingit on existing Grid services technologies. Finally we examinealternative implementations of that service.