Implementation and evaluation of active storage in modern parallel file systems

  • Authors:
  • Juan Piernas-Canovas;Jarek Nieplocha

  • Affiliations:
  • Pacific Northwest National Laboratory, P.O. Box 999, Richland, WA 99352, USA and University of Murcia, Avda Teniente Flomesta, 5, 30003 Murcia, Spain;Pacific Northwest National Laboratory, P.O. Box 999, Richland, WA 99352, USA

  • Venue:
  • Parallel Computing
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Active Storage is a technology aimed at reducing the bandwidth requirements of current supercomputing systems, and leveraging the processing power of the storage nodes used by some modern file systems. To achieve both objectives, Active Storage moves certain processing tasks to the storage nodes, near the data they manage. Our proposal for Active Storage has several key features: user-space implementation which facilitates the port to different file systems, analytical model to anticipate the performance of Active Storage with respect to a traditional system, support for striped files and complex-format files such as netCDF, and scientific-friendly programming and run-time environment.