I/O Requirements of Scientific Applications: An Evolutionary View

Authors:
Evgenia Smirni;Ruth A. Aydt;Andrew A. Chien;Daniel A. Reed
Affiliations:
-;-;-;-
Venue:
HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
Year:
1996

Citing 5
Cited 4

Multicast routing in datagram internetworks and extended LANs

ACM Transactions on Computer Systems (TOCS)
Execution time support for adaptive scientific algorithms on distributed

Concurrency: Practice and Experience
Run-time load balancing support for a parallel multiblock Euler/Navier-Stokes code with adaptive refinement on distributed memory computers

Parallel Computing
Communication Issues in Parallel Computing Across ATM Networks

IEEE Parallel & Distributed Technology: Systems & Technology
Partitioning Unstructured Computational Graphs for Nonuniform and Adaptive Environments

IEEE Parallel & Distributed Technology: Systems & Technology

Models of Parallel Applications with Large Computation and I/O Requirements

IEEE Transactions on Software Engineering
Intelligent, adaptive file system policy selection

FRONTIERS '96 Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation
Large files, small writes, and pNFS

Proceedings of the 20th annual international conference on Supercomputing
Massively parallel genomic sequence search on the Blue Gene/P architecture

Proceedings of the 2008 ACM/IEEE conference on Supercomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

The modest I/O configurations and file system limitations of many current high-performance systems preclude solution of problems with large I/O needs. I/O hardware and file system parallelism is the key to achieve high performance. We analyze the I/O behavior of several versions of two scientific applications on the Intel Paragon XP/S. The versions involve incremental application code enhancements across multiple releases of the operating system. Studying the evolution of I/O access patterns underscores the interplay between application access patterns and file system features. Our results show that both small and large request sizes are common, that at present application developers must manually aggregate small requests to obtain high disk transfer rates, that concurrent file accesses are frequent, and that appropriate matching of the application access pattern and the file system access mode can significantly increase application I/O performance. Based on these results, we describe a set of file system design principles.