A data management system for UNICORE 6

  • Authors:

  • Tobias Schlauch;Anastasia Eifer;Thomas Soddemann;Andreas Schreiber

  • Affiliations:

  • Simulation and Software Technology, German Aerospace Center, Cologne, Germany;Simulation and Software Technology, German Aerospace Center, Cologne, Germany;Fraunhofer Institute for Algorithms and Scientific Computing, Sankt Augustin, Germany;Simulation and Software Technology, German Aerospace Center, Cologne, Germany

  • Venue:
  • Euro-Par'09 Proceedings of the 2009 international conference on Parallel processing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Data produced in scientific and industrial applications is growing exponentially but most resource middleware systems lack of appropriate support for data and metadata management. In particular easy and intuitive retrieval of data for later use is a serious problem. In this context the paper proposes a pragmatic approach for data management of distributed data with focus on appropriate means for data organization improving data retrieval. The paper presents the key concepts and architecture of a dedicated data management system for sharing data located on heterogeneous storage resources. The different specifics of storage systems such as data object names, data locations, and data access methods are abstracted to allow transparent data access. Moreover, the system provides means for data structuring and organization by supporting custom data models and annotation of individual metadata on data objects. Current development status of the system is illustrated by presenting an integration with the UNICORE Rich Client which has been validated in the context of the AeroGrid project.