VisageFS dynamic storage features for wide-area workflows

  • Authors:
  • François Thiebolt;Aurélien Ortiz;Abdelaziz M'zoughi

  • Affiliations:
  • Université Paul Sabatier Toulouse III, France;Université Paul Sabatier Toulouse III, France;Université Paul Sabatier Toulouse III, France

  • Venue:
  • PDCS '07 Proceedings of the 19th IASTED International Conference on Parallel and Distributed Computing and Systems
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Nowadays, the disk storage's skyrocketing capacity has led to an amazing situation: grid-scale gathered storage of client nodes can overcome even the largest centralised storage units. Thus, one of the key challenges related to the grid environment is to federate such spread storage resources together. Thereby, we have developed Vis-ageFS, a Posix compliant, wide-area file system. It is mainly built upon a storage virtualization layer, plug-ins aware coherency layer and a multi-tiered administration and monitoring service. However, once featured with a global namespace fuelled by heterogeneous storage, the wide-area job scheduler is willing to be aware of data location. Furthermore, depending on workload, it may be highly desirable to make use of local storage facilities without data staging penalties. In this paper, we present one dynamic storage feature intended to provide transparent local storage access while remaining within the VisageFS global namespace.