Pattern Matching and I/O Replay for POSIX I/O in Parallel Programs

Authors:
Michael Kluge;Andreas Knüpfer;Matthias Müller;Wolfgang E. Nagel
Affiliations:
Technische Universität Dresden, Dresden, Germany;Technische Universität Dresden, Dresden, Germany;Technische Universität Dresden, Dresden, Germany;Technische Universität Dresden, Dresden, Germany
Venue:
Euro-Par '09 Proceedings of the 15th International Euro-Par Conference on Parallel Processing
Year:
2009

Citing 9
Cited 2

Effective File-I/O Bandwidth Benchmark

Euro-Par '00 Proceedings from the 6th International Euro-Par Conference on Parallel Processing
A Survey of Longest Common Subsequence Algorithms

SPIRE '00 Proceedings of the Seventh International Symposium on String Processing Information Retrieval (SPIRE'00)
Formulation of a Galerkin spectral element-fourier method for three-dimensional incompressible flows in cylindrical geometries

Journal of Computational Physics
Tracefs: A File System to Trace Them All

FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
Trace: parallel trace replay with approximate causal events

FAST '07 Proceedings of the 5th USENIX conference on File and Storage Technologies
A framework to develop symbolic performance models of parallel applications

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Evaluating I/O characteristics and methods for storing structured scientific data

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
IOAgent: a parallel I/O workload generator

Euro-Par'06 Proceedings of the 12th international conference on Parallel Processing
Introducing the open trace format (OTF)

ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part II

Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles

ACM SIGOPS 24th Symposium on Operating Systems Principles
ROOT: replaying multithreaded traces with resource-oriented ordering

Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes an approach to track, compress and replay I/O calls from a parallel application. We will introduce our method to capture calls to POSIX I/O functions and to create I/O dependency graphs for parallel program runs. The resulting graphs will be compressed by a pattern matching algorithm and used as an input for a flexible I/O benchmark. The first parts of the paper cover the information gathering and compression in the area of POSIX I/O while the later parts are dedicated to the I/O benchmark and to some results from experiments.