Modeling a leadership-scale storage system

Authors:
Ning Liu;Christopher Carothers;Jason Cope;Philip Carns;Robert Ross;Adam Crume;Carlos Maltzahn
Affiliations:
Rensselaer Polytechnic Institute, Troy, NY;Rensselaer Polytechnic Institute, Troy, NY;Argonne National Laboratory, Argonne, IL;Argonne National Laboratory, Argonne, IL;Argonne National Laboratory, Argonne, IL;University of California at Santa Cruz, Santa Cruz, CA;University of California at Santa Cruz, Santa Cruz, CA
Venue:
PPAM'11 Proceedings of the 9th international conference on Parallel Processing and Applied Mathematics - Volume Part I
Year:
2011

Citing 15
Cited 1

Large-Scale TCP Models Using Optimistic Parallel Simulation

Proceedings of the seventeenth workshop on Parallel and distributed simulation
Large-scale network simulation techniques: examples of TCP and OSPF models

ACM SIGCOMM Computer Communication Review
Designing a highly-scalable operating system: the Blue Gene/L story

Proceedings of the 2006 ACM/IEEE conference on Supercomputing
PVFS: a parallel file system for linux clusters

ALS'00 Proceedings of the 4th annual Linux Showcase & Conference - Volume 4
Overview of the IBM Blue Gene/P project

IBM Journal of Research and Development
Scalable Time Warp on Blue Gene Supercomputers

PADS '09 Proceedings of the 2009 ACM/IEEE/SCS 23rd Workshop on Principles of Advanced and Distributed Simulation
I/O performance challenges at leadership scale

Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
A study of client-based caching for parallel i/o

A study of client-based caching for parallel i/o
μπ: a scalable and transparent system for simulating MPI programs

Proceedings of the 3rd International ICST Conference on Simulation Tools and Techniques
Simulating Large Scale Parallel Applications Using Statistical Models for Sequential Execution Blocks

ICPADS '10 Proceedings of the 2010 IEEE 16th International Conference on Parallel and Distributed Systems
Hierarchical performance measurement and modeling of the linux file system

Proceedings of the 2nd ACM/SPEC International Conference on Performance engineering
The structural simulation toolkit

ACM SIGMETRICS Performance Evaluation Review - Special issue on the 1st international workshop on performance modeling, benchmarking and simulation of high performance computing systems (PMBS 10)
GPFS: a shared-disk file system for large computing clusters

FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Modeling Billion-Node Torus Networks Using Massively Parallel Discrete-Event Simulation

PADS '11 Proceedings of the 2011 IEEE Workshop on Principles of Advanced and Distributed Simulation
File system simulation: hierachical performance measurement and modeling

File system simulation: hierachical performance measurement and modeling

Warp speed: executing time warp on 1,966,080 cores

Proceedings of the 2013 ACM SIGSIM conference on Principles of advanced discrete simulation

Quantified Score

Hi-index	0.00

Visualization

Abstract

Exascale supercomputers will have the potential for billion-way parallelism. While physical implementations of these systems are currently not available, HPC system designers can develop models of exascale systems to evaluate system design points. Modeling these systems and associated subsystems is a significant challenge. In this paper, we present the Co-design of Exascale Storage System (CODES) framework for evaluating exascale storage system design points. As part of our early work with CODES, we discuss the use of the CODES framework to simulate leadership-scale storage systems in a tractable amount of time using parallel discrete-event simulation. We describe the current storage system models and protocols included with the CODES framework and demonstrate the use of CODES through simulations of an existing petascale storage system.