Visual analysis of I/O system behavior for high-end computing

Authors:
Christopher Muelder;Carmen Sigovan;Kwan-Liu Ma;Jason Cope;Sam Lang;Kamil Iskra;Pete Beckman;Robert Ross
Affiliations:
University of California, Davis, Davis, CA, USA;University of California, Davis, Davis, CA, USA;University of California, Davis, Davis, CA, USA;Argonne National Laboratory, Argonne, IL, USA;Argonne National Laboratory, Argonne, IL, USA;Argonne National Laboratory, Argonne, IL, USA;Argonne National Laboratory, Argonne, IL, USA;Argonne National Laboratory, Argonne, IL, USA
Venue:
Proceedings of the third international workshop on Large-scale system and application performance
Year:
2011

Citing 20
Cited 4

Visualizing interactions in program executions

ICSE '97 Proceedings of the 19th international conference on Software engineering
From trace generation to visualization: a performance framework for distributed parallel systems

Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Virtue: Performance Visualization of Parallel and Distributed Applications

Computer
GPFS: A Shared-Disk File System for Large Computing Clusters

FAST '02 Proceedings of the Conference on File and Storage Technologies
Debugging Massively Parallel Programs with ATEMPT

HPCN Europe 1996 Proceedings of the International Conference and Exhibition on High-Performance Computing and Networking
Debugging Point-to-Point Communication in MPI an PVM

Proceedings of the 5th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
A Parallel Visualization Pipeline for Terascale Earthquake Simulations

Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Parallel netCDF: A High-Performance Scientific I/O Interface

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
A study of I/O methods for parallel visualization of large-scale data

Parallel Computing - Parallel graphics and visualization
Revealing Structure within Clustered Parallel Coordinates Displays

INFOVIS '05 Proceedings of the Proceedings of the 2005 IEEE Symposium on Information Visualization
The Tau Parallel Performance System

International Journal of High Performance Computing Applications
Operating system issues for petascale systems

ACM SIGOPS Operating Systems Review
Characterizing the I/O behavior of scientific applications on the Cray XT

PDSW '07 Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07
An efficient format for nearly constant-time access to arbitrary time intervals in large trace files

Scientific Programming - Large-Scale Programming Tools and Environments
Analyzing the reliability of communication between software entities using a 3D visualization of clustered graphs

Proceedings of the 4th ACM symposium on Software visualization
Execution trace analysis through massive sequence and circular bundle views

Journal of Systems and Software
Visual Analysis of Inter-Process Communication for Large-Scale Parallel Computing

IEEE Transactions on Visualization and Computer Graphics
Optimization Techniques at the I/O Forwarding Layer

CLUSTER '10 Proceedings of the 2010 IEEE International Conference on Cluster Computing
Multiscale visualization of dynamic software logs

EUROVIS'07 Proceedings of the 9th Joint Eurographics / IEEE VGTC conference on Visualization
Analysis of the MPI-IO optimization levels with the PIOViz Jumpshot enhancement

PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface

Enabling event tracing at leadership-class scale through I/O forwarding middleware

Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing
Making problem diagnosiswork for large-scale, production storage systems

LISA'13 Proceedings of the 27th international conference on Large Installation System Administration
Optimizing I/O forwarding techniques for extreme-scale event tracing

Cluster Computing
Visualizing large-scale parallel communication traces using a particle animation technique

EuroVis '13 Proceedings of the 15th Eurographics Conference on Visualization

Quantified Score

Hi-index	0.00

Visualization

Abstract

As supercomputers grow ever larger, so too do application run times and data requirements. The operational patterns of modern parallel I/O systems are far too complex to allow for a direct analysis of their trace logs. Several visualization methods have therefore been developed to address this issue. Traditional, direct visualizations of parallel systems, such as Gantt charts, can be applied to parallel file systems, but do they not capture domain specific properties nor scale up to modern systems. We propose a portable I/O tracing system and visualization methods to analyze the traces we have obtained. We demonstrate the effectiveness of this system on existing parallel storage systems.