Evaluating structured I/O methods for parallel file systems
International Journal of High Performance Computing and Networking
Towards a High Performance Implementation of MPI-IO on the Lustre File System
OTM '08 Proceedings of the OTM 2008 Confederated International Conferences, CoopIS, DOA, GADA, IS, and ODBASE 2008. Part I on On the Move to Meaningful Internet Systems:
Proceedings of the 18th ACM international symposium on High performance distributed computing
Conflict Detection Algorithm to Minimize Locking for MPI-IO Atomicity
Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
InterferenceRemoval: removing interference of disk access for MPI programs through data replication
Proceedings of the 24th ACM International Conference on Supercomputing
MRAP: a novel MapReduce-based framework to support HPC analytics applications with access patterns
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
IOrchestrator: Improving the Performance of Multi-node I/O Systems via Inter-Server Coordination
Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
Evaluating I/O characteristics and methods for storing structured scientific data
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
FAST'11 Proceedings of the 9th USENIX conference on File and stroage technologies
A cost-intelligent application-specific data layout scheme for parallel file systems
Proceedings of the 20th international symposium on High performance distributed computing
Symmetrical data sieving for noncontiguous i/o accesses in molecular dynamics simulations
PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Pattern-aware file reorganization in MPI-IO
Proceedings of the sixth workshop on Parallel Data Storage
Enabling event tracing at leadership-class scale through I/O forwarding middleware
Proceedings of the 21st international symposium on High-Performance Parallel and Distributed Computing
Optimizing I/O forwarding techniques for extreme-scale event tracing
Cluster Computing
| Hi-index | 0.01 |
I/O performance remains a weakness of parallel computingsystems today. While this weakness is partly attributedto rapid advances in other system components, I/Ointerfaces available to programmers and the I/O methodssupported by file systems have traditionally not matchedefficiently with the types of I/O operations that scientific applicationsperform, particularly noncontiguous accesses.The MPI-IO interface allows for rich descriptions of theI/O patterns desired for scientific applications and implementationssuch as ROMIO have taken advantage of thisability while remaining limited by underlying file systemmethods.A method of noncontiguous data access, list I/O, wasrecently implemented in the Parallel Virtual File System(PVFS). We implement support for this interface in theROMIO MPI-IO implementation. Through a suite of non-contiguousI/O tests we compared ROMIO list I/O to currentmethods of ROMIO noncontiguous access and foundthat the list I/O interface provides performance benefits inmany noncontiguous cases.