I/O Requirements of Scientific Applications: An Evolutionary View

  • Authors:
  • E. Smirni;R. A. Aydt;A. A. Chen;D. A. Reed

  • Affiliations:
  • -;-;-;-

  • Venue:
  • HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

The modest NO configurations and file system limitations of many current high-performance systems preclude solution of problems with large II0 needs. II0 hardware and file sys-tem parallelism is the key to achieve high performance. We analyze the II0 behavior of several versions of two scientific applications on the Intel Paragon XPIS. The versions involve incremental application code enhancements across multiple releases of the operating system. Studying the evolution of II0 access patterns underscores the interplay between application access patterns and file system features. Our results show that both small and large request sizes are common, that at present application developers must manually aggregate small requests to obtain high disk transfer rates, that concurrent file accesses are frequent, and that appropriate matching of the application access pattern and the file system access mode can significantly increase application II0 performance. Based on these results, we describe a set of file system design principles.