Building Hierarchical Grid Storage Using the Gfarm Global File System and the JuxMem Grid Data-Sharing Service

  • Authors:
  • Gabriel Antoniu;Loïc Cudennec;Majd Ghareeb;Osamu Tatebe

  • Affiliations:
  • INRIA/IRISA, Campus de Beaulieu, Rennes Cedex, France F-35042;INRIA/IRISA, Campus de Beaulieu, Rennes Cedex, France F-35042;INRIA/IRISA, Campus de Beaulieu, Rennes Cedex, France F-35042;University of Tsukuba, Japan

  • Venue:
  • Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

As more and more large-scale applications need to generate and process very large volumes of data, the need for adequate storage facilities is growing. It becomes crucial to efficiently and reliably store and retrieve large sets of data that may be shared at the global scale. Based on previous systems for global data sharing (global file systems, grid data-sharing services), this paper proposes a hierarchical approach for grid storage, which combines the access efficiency of RAM storage with the scalability and persistence of the global file system approach. Our proposal has been validated through a prototype that couples the Gfarmfile system with the JuxMemdata-sharing service. Experiments on the Grid'5000 testbed confirm the advantages of our approach.