Managing NFS and NIS
Applications-driven parallel I/O
Proceedings of the 1993 ACM/IEEE conference on Supercomputing
Extensible file system (ELFS): an object-oriented approach to high performance file I/O
OOPSLA '94 Proceedings of the ninth annual conference on Object-oriented programming systems, language, and applications
Shoring up persistent applications
SIGMOD '94 Proceedings of the 1994 ACM SIGMOD international conference on Management of data
Ptool: a scalable persistent object manager
SIGMOD '94 Proceedings of the 1994 ACM SIGMOD international conference on Management of data
Server-directed collective I/O in Panda
Supercomputing '95 Proceedings of the 1995 ACM/IEEE conference on Supercomputing
PPFS: a high performance portable parallel file system
ICS '95 Proceedings of the 9th international conference on Supercomputing
Proceedings of the fourth workshop on I/O in parallel and distributed systems: part of the federated computing research conference
HFS: a performance-oriented flexible file system based on building-block compositions
Proceedings of the fourth workshop on I/O in parallel and distributed systems: part of the federated computing research conference
The galley parallel file system
ICS '96 Proceedings of the 10th international conference on Supercomputing
An extended two-phase method for accessing sections of out-of-core arrays
Scientific Programming
Proceedings of the Third International ACPC Conference with Special Emphasis on Parallel Databases and Parallel I/O: Parallel Computation
The Scotch parallel storage systems
COMPCON '95 Proceedings of the 40th IEEE Computer Society International Conference
Disk-directed I/O for MIMD multiprocessors
OSDI '94 Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation
From the I-WAY to the National Technology Grid
Communications of the ACM
Remote I/O: fast access to distant storage
Proceedings of the fifth workshop on I/O in parallel and distributed systems
On implementing MPI-IO portably and with high performance
Proceedings of the sixth workshop on I/O in parallel and distributed systems
A case for using MPI's derived datatypes to improve I/O performance
SC '98 Proceedings of the 1998 ACM/IEEE conference on Supercomputing
MPI/IO on DAFS over VIA: Implementation and Performance Evaluation
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Stampi-I/O: A Flexible Parallel-I/O Library for Heterogeneous Computing Environment
Proceedings of the 9th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
An Adaptive Cache Coherence Protocol Specification for Parallel Input/Output Systems
IEEE Transactions on Parallel and Distributed Systems
Parallel netCDF: A High-Performance Scientific I/O Interface
Proceedings of the 2003 ACM/IEEE conference on Supercomputing
International Journal of High Performance Computing Applications
Startup comparison for message passing libraries with DTM on linux clusters
The Journal of Supercomputing
PVFS: a parallel file system for linux clusters
ALS'00 Proceedings of the 4th annual Linux Showcase & Conference - Volume 4
A global and parallel file system for grids
Future Generation Computer Systems - Special section: Data mining in grid computing environments
Using MPI file caching to improve parallel write performance for large-scale scientific applications
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Scaling parallel I/O performance through I/O delegate and caching system
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Empirical Analysis of a Large-Scale Hierarchical Storage System
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Towards a High Performance Implementation of MPI-IO on the Lustre File System
OTM '08 Proceedings of the OTM 2008 Confederated International Conferences, CoopIS, DOA, GADA, IS, and ODBASE 2008. Part I on On the Move to Meaningful Internet Systems:
Implementing a Parallel NetCDF Interface for Seamless Remote I/O Using Multi-dimensional Data
High Performance Computing for Computational Science - VECPAR 2008
Proceedings of the 18th ACM international symposium on High performance distributed computing
Latency Hiding File I/O for Blue Gene Systems
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Multiple-Level MPI File Write-Back and Prefetching for Blue Gene Systems
Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
pNFS, POSIX, and MPI-IO: a tale of three semantics
Proceedings of the 4th Annual Workshop on Petascale Data Storage
Implementation and Evaluation of File Write-Back and Prefetching for MPI-IO Over GPFS
International Journal of High Performance Computing Applications
Remote MPI-I/O on parallel virtual file system using a circular buffer for high throughput
International Journal of Computers and Applications
An expandable parallel file system using NFS servers
VECPAR'02 Proceedings of the 5th international conference on High performance computing for computational science
A Scalable Message Passing Interface Implementation of an Ad-Hoc Parallel I/o system
International Journal of High Performance Computing Applications
A study of real world I/O performance in parallel scientific computing
PARA'06 Proceedings of the 8th international conference on Applied parallel computing: state of the art in scientific computing
Grid computing: experiment management, tool integration, and scientific workflows
Grid computing: experiment management, tool integration, and scientific workflows
Accelerating parallel analysis of scientific simulation data via Zazen
FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
Design and implementation of parallel file aggregation mechanism
Proceedings of the 1st International Workshop on Runtime and Operating Systems for Supercomputers
OMPIO: a modular software architecture for MPI I/O
EuroMPI'11 Proceedings of the 18th European MPI Users' Group conference on Recent advances in the message passing interface
High-Bandwidth remote parallel i/o with the distributed memory filesystem MEMFS
EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface
Effective seamless remote MPI-I/O operations with derived data types using PVFS2
EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface
Remote parallel i/o in grid environments
PPAM'05 Proceedings of the 6th international conference on Parallel Processing and Applied Mathematics
Cooperative write-behind data buffering for MPI i/o
PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Optimization of nonblocking MPI-I/O to a remote parallel virtual file system using a circular buffer
HPCC'05 Proceedings of the First international conference on High Performance Computing and Communications
Pipelining network storage i/o
ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part I
Flexible i/o support for reconfigurable grid environments
Euro-Par'06 Proceedings of the 12th international conference on Parallel Processing
Data driven infrastructure and policy selection to enhance scientific applications in grid
SAG'04 Proceedings of the First international conference on Scientific Applications of Grid Computing
Effective parallelization of loops in the presence of I/O operations
Proceedings of the 33rd ACM SIGPLAN conference on Programming Language Design and Implementation
Transparent log-based data storage in MPI-IO applications
PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Memory-conscious collective I/O for extreme scale HPC systems
Proceedings of the 3rd International Workshop on Runtime and Operating Systems for Supercomputers
Structuring PLFS for extensibility
PDSW '13 Proceedings of the 8th Parallel Data Storage Workshop
Hi-index | 0.02 |
In this paper, we propose a strategy for implementing parallel-I/O interfaces portably and efficiently. We have defined an abstract-device interface for parallel I/O, called ADIO. Any parallel-I/O API can be implemented on multiple file systems by implementing the API portably on top of ADIO, and implementing only ADIO on different file systems. This approach simplifies the task of implementing an API and yet exploits the specific high-performance features of individual file systems. We have used ADIO to implement the Intel PFS interface and subsets of MPI-IO and IBM PI-OFS interfaces on PFS, PIOFS, Unix, and NFS file systems. Our performance studies indicate that the overhead of using ADIO as an implementation strategy is very low.