Fast Parallel Non-Contiguous File Access
Proceedings of the 2003 ACM/IEEE conference on Supercomputing
High performance support of parallel virtual file system (PVFS2) over Quadrics
Proceedings of the 19th annual international conference on Supercomputing
Evaluating structured I/O methods for parallel file systems
International Journal of High Performance Computing and Networking
Noncontiguous locking techniques for parallel file systems
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Exploring the performance impact of stripe size on network attached storage systems
Journal of Systems Architecture: the EUROMICRO Journal
A comparative experimental study of parallel file systems for large-scale data processing
LASCO'08 First USENIX Workshop on Large-Scale Computing
Conflict Detection Algorithm to Minimize Locking for MPI-IO Atomicity
Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
I/O performance challenges at leadership scale
Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
A profiling approach for the management of writing in irregular applications
ISPA'06 Proceedings of the 2006 international conference on Frontiers of High Performance Computing and Networking
RRBS: a fault tolerance model for cluster/grid parallel file system
ISPA'05 Proceedings of the Third international conference on Parallel and Distributed Processing and Applications
Symmetrical data sieving for noncontiguous i/o accesses in molecular dynamics simulations
PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
The subgroup method for collective i/o
PDCAT'04 Proceedings of the 5th international conference on Parallel and Distributed Computing: applications and Technologies
| Hi-index | 0.00 |
With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of parallel file systems has helped to ease the performance gap, but I/O still remains an area needing significant performance improvement. Research has found that noncontiguous I/O access patterns in scientific applications combined with current file system methods to perform these accesses lead to unacceptable performance for large data sets. To enhance performance of noncontiguous I/O, we have created list I/O, a native version of noncontiguous I/O. We have used the Parallel Virtual File System (PVFS) to implement our ideas. Our research and experimentation shows that list I/O outperforms current noncontiguous I/O access methods in most I/O situations and can substantially enhance the performance of real-world scientific applications.