Examples of in transit visualization

Authors:
Kenneth Moreland;Ron Oldfield;Pat Marion;Sebastien Jourdain;Norbert Podhorszki;Venkatram Vishwanath;Nathan Fabian;Ciprian Docan;Manish Parashar;Mark Hereld;Michael E. Papka;Scott Klasky
Affiliations:
Sandia National Laboratories, Albuquerque, NM, USA;Sandia National Laboratories, Albuquerque, NM, USA;Kitware, Inc, Clifton Park, NY, USA;Kitware, Inc., Clifton Park, NY, USA;Oak Ridge National Laboratory, Oak Ridge, TN, USA;Argonne National Laboratory, Argonne, IL, USA;Sandia National Laboratories, Albuquerque, NM, USA;Rutgers University, Piscataway, NJ, USA;Rutgers University, Piscataway, NJ, USA;Argonne National Laboratory, Argonne, IL, USA;Argonne National Laboratory, Argonne, IL, USA;Oak Ridge National Laboratory, Oak Ridge, TN, USA
Venue:
Proceedings of the 2nd international workshop on Petascal data analytics: challenges and opportunities
Year:
2011

Citing 17
Cited 2

Multidimensional array I/O in Panda 1.0

The Journal of Supercomputing
Interactive Simulation and Visualization

Computer
A Steering Environment for Online Parallel Visualization of Legacy Parallel Simulations

DS-RT '06 Proceedings of the 10th IEEE international symposium on Distributed Simulation and Real-Time Applications
Modeling the Impact of Checkpoints on Next-Generation Systems

MSST '07 Proceedings of the 24th IEEE Conference on Mass Storage Systems and Technologies
Scaling parallel I/O performance through I/O delegate and caching system

Proceedings of the 2008 ACM/IEEE conference on Supercomputing
DataStager: scalable data staging services for petascale applications

Proceedings of the 18th ACM international symposium on High performance distributed computing
Adaptable, metadata rich IO methods for portable high performance IO

IPDPS '09 Proceedings of the 2009 IEEE International Symposium on Parallel&Distributed Processing
End-to-End Study of Parallel Volume Rendering on the IBM Blue Gene/P

ICPP '09 Proceedings of the 2009 International Conference on Parallel Processing
...and eat it too: high read performance in write-optimized HPC I/O middleware file formats

Proceedings of the 4th Annual Workshop on Petascale Data Storage
Experiments with Memory-to-Memory Coupling for End-to-End Fusion Simulation Workflows

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
DataSpaces: an interaction and coordination framework for coupled simulation workflows

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Managing Variability in the IO Performance of Petascale Storage Systems

Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
Enabling Multi-physics Coupled Simulations within the PGAS Programming Framework

CCGRID '11 Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing
Topology-aware data movement and staging for I/O acceleration on Blue Gene/P supercomputing systems

Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
EDO: Improving Read Performance for Scientific Applications through Elastic Data Organization

CLUSTER '11 Proceedings of the 2011 IEEE International Conference on Cluster Computing
Parallel volume rendering on the IBM Blue Gene/P

EG PGV'08 Proceedings of the 8th Eurographics conference on Parallel Graphics and Visualization
Parallel computational steering and analysis for HPC applications using a paraview interface and the HDF5 DSM virtual file driver

EG PGV'11 Proceedings of the 11th Eurographics conference on Parallel Graphics and Visualization

Hobbes: composition and virtualization as the foundations of an extreme-scale OS/R

Proceedings of the 3rd International Workshop on Runtime and Operating Systems for Supercomputers
Trilinos I/O Support Trios

Scientific Programming - A New Overview of the Trilinos Project --Part 1

Quantified Score

Hi-index	0.00

Visualization

Abstract

One of the most pressing issues with petascale analysis is the transport of simulation results data to a meaningful analysis. Traditional workflow prescribes storing the simulation results to disk and later retrieving them for analysis and visualization. However, at petascale this storage of the full results is prohibitive. A solution to this problem is to run the analysis and visualization concurrently with the simulation and bypass the storage of the full results. One mechanism for doing so is in transit visualization in which analysis and visualization is run on I/O nodes that receive the full simulation results but write information from analysis or provide run-time visualization. This paper describes the work in progress for three in transit visualization solutions, each using a different transport mechanism.