On evaluating decentralized parallel I/O scheduling strategies for parallel file systems

  • Authors:
  • Florin Isaila;David Singh;Jesús Carretero;Félix Garcia

  • Affiliations:
  • Department of Compute Science, University Carlos III de Madrid, Spain;Department of Compute Science, University Carlos III de Madrid, Spain;Department of Compute Science, University Carlos III de Madrid, Spain;Department of Compute Science, University Carlos III de Madrid, Spain

  • Venue:
  • VECPAR'06 Proceedings of the 7th international conference on High performance computing for computational science
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper evaluates the impact of the parallel I/O scheduling strategy on the performance of the file access in a parallel file system for clusters of commodity computers (Clusterfile). We argue that the parallel I/O scheduling strategy should be seen as a complement to other file access optimizations like striping over several I/O servers, non-contiguous I/O and collective I/O. Our study is based on three simple decentralized parallel I/O heuristics implemented inside Clusterfile. The measurements in a real environment show that the performance of parallel file access may vary with as much as 86% for writing and 804% for reading with the employed heuristic and with the schedule block granularity.