Poster: I/O workload analysis with server-side data collection

  • Authors:
  • Andrew Uselton;Daniela Ushizima

  • Affiliations:
  • LBNL, Berkeley, CA, USA;LBNL, Berkeley, CA, USA

  • Venue:
  • Proceedings of the 2011 companion on High Performance Computing Networking, Storage and Analysis Companion
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

A detailed understanding of high-performance computer (HPC) file system read and write (I/O) workloads allows stakeholders to evaluate the effectiveness of the I/O infrastructure and identify bottlenecks and other issues. Always-on, server-side monitoring, like that provided by the Lustre Monitoring Tool, permits a comprehensive and nonintrusive mechanism for capturing details of the I/O workload. The statistical properties of data movement to and from mass storage on an HPC system reveal transaction patterns that connect the server-side observations back to the computer-side jobs that caused them. This paper lays out strategies to characterize such patterns using I/O statistics.