A case for redundant arrays of inexpensive disks (RAID)
SIGMOD '88 Proceedings of the 1988 ACM SIGMOD international conference on Management of data
File concepts for parallel I/O
Proceedings of the 1989 ACM/IEEE conference on Supercomputing
IEEE Spectrum - Supercomputing
An experimental performance evaluation of Touchstone Delta Concurrent File System
ICS '93 Proceedings of the 7th international conference on Supercomputing
Compiler and runtime support for out-of-core HPF programs
ICS '94 Proceedings of the 8th international conference on Supercomputing
Compilation of out-of-core data parallel programs for distributed memory machines
ACM SIGARCH Computer Architecture News - Special issue on input/output in parallel computer systems
ACM SIGOPS Operating Systems Review
Parallel file systems for the IBM SP computers
IBM Systems Journal
pC++/streams: a library for I/O on complex distributed data sources
PPOPP '95 Proceedings of the fifth ACM SIGPLAN symposium on Principles and practice of parallel programming
A prefetching prototype for the parallel file systems on the Paragon
Proceedings of the 1995 ACM SIGMETRICS joint international conference on Measurement and modeling of computer systems
Communication strategies for out-of-core programs on distributed memory machines
ICS '95 Proceedings of the 9th international conference on Supercomputing
Flexibility and performance of parallel file systems
ACM SIGOPS Operating Systems Review
Tuning the performance of I/O-intensive parallel applications
Proceedings of the fourth workshop on I/O in parallel and distributed systems: part of the federated computing research conference
HFS: a performance-oriented flexible file system based on building-block compositions
Proceedings of the fourth workshop on I/O in parallel and distributed systems: part of the federated computing research conference
File-Access Characteristics of Parallel Scientific Workloads
IEEE Transactions on Parallel and Distributed Systems
Strategic directions in storage I/O issues in large-scale computing
ACM Computing Surveys (CSUR) - Special ACM 50th-anniversary issue: strategic directions in computing research
Heuristics for Scheduling I/O Operations
IEEE Transactions on Parallel and Distributed Systems
HFS: a performance-oriented flexible file system based on building-block compositions
ACM Transactions on Computer Systems (TOCS)
BFXM: a parallel file system model based on the mechanism of distributed shared memory
ACM SIGOPS Operating Systems Review
Thread scheduling for out-of-core applications with memory server on multicomputers
Proceedings of the sixth workshop on I/O in parallel and distributed systems
Tight Bounds for Prefetching and Buffer Management Algorithms for Parallel I/O Systems
IEEE Transactions on Parallel and Distributed Systems
Storage System and Multimedia: Classification and Extensions
Distributed and Parallel Databases
A novel application development environment for large-scale scientific computations
Proceedings of the 14th international conference on Supercomputing
An evaluation of Java's I/O capabilities for high-performance computing
Proceedings of the ACM 2000 conference on Java Grande
Integrating parallel file I/O and database support for high-performance scientific data management
Proceedings of the 2000 ACM/IEEE conference on Supercomputing
Compiler-based I/O prefetching for out-of-core applications
ACM Transactions on Computer Systems (TOCS)
Compiler-Directed Collective-I/O
IEEE Transactions on Parallel and Distributed Systems
Optimization and evaluation of Hartree-Fock application's I/O with PASSION
SC '97 Proceedings of the 1997 ACM/IEEE conference on Supercomputing
An Experimental Evaluation of I/O Optimizations on Different Applications
IEEE Transactions on Parallel and Distributed Systems
An I/O-Conscious Tiling Strategy for Disk-Resident Data Sets
The Journal of Supercomputing
Dynamic file-access characteristics of a production parallel scientific workload
Proceedings of the 1994 ACM/IEEE conference on Supercomputing
Design and implementation of a parallel I/O runtime system for irregular applications
Journal of Parallel and Distributed Computing
File-System Workload on a Scientific Multiprocessor
IEEE Parallel & Distributed Technology: Systems & Technology
An Experimental Evaluation of I/O Optimizations on Different Applications
IEEE Transactions on Parallel and Distributed Systems
Meta-data Management System for High-Performance Large-Scale Scientific Data Access
HiPC '00 Proceedings of the 7th International Conference on High Performance Computing
Performance Prediction and Analysis of Parallel Out-Of-Core Matrix Factorization
HiPC '00 Proceedings of the 7th International Conference on High Performance Computing
Fault-Tolerant Parallel Applications Using Queues and Actions
ICPP '97 Proceedings of the international Conference on Parallel Processing
Improving the Performance of Out-of-Core Computations
ICPP '97 Proceedings of the international Conference on Parallel Processing
An Experimental Study of Input/Output Characteristics of NASA Earth and Space Sciences Applications
IPPS '96 Proceedings of the 10th International Parallel Processing Symposium
Implementation and Evaluation of Prefetching in the Intel Paragon Parallel File System
IPPS '96 Proceedings of the 10th International Parallel Processing Symposium
Compiler-Directed I/O Optimization
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
A Scientific Data Management System for Irregular Applications
IPDPS '01 Proceedings of the 15th International Parallel & Distributed Processing Symposium
Design and Evaluation of a Compiler-Directed Collective I/O Technique
Euro-Par '00 Proceedings from the 6th International Euro-Par Conference on Parallel Processing
A Collective I/O Scheme Based on Compiler Analysis
LCR '00 Selected Papers from the 5th International Workshop on Languages, Compilers, and Run-Time Systems for Scalable Computers
Graph visualization for the analysis of the structure and dynamics of extreme-scale supercomputers
Proceedings of the 2003 ACM symposium on Software visualization
A statistically-based multi-algorithmic approach for load-balancing sparse matrix computations
FRONTIERS '96 Proceedings of the 6th Symposium on the Frontiers of Massively Parallel Computation
Impact of delays in parallel I/O system: an empirical study
HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
The parallel I/O architecture of the high-performance storage system (HPSS)
MSS '95 Proceedings of the 14th IEEE Symposium on Mass Storage Systems
Dynamic Access Load Balancing on the Parallel Secondary Storage
PAS '97 Proceedings of the 2nd AIZU International Symposium on Parallel Algorithms / Architecture Synthesis
High-performance scientific data management system
Journal of Parallel and Distributed Computing
Sourcebook of parallel computing
An integrated platform for quality-of-service support in mobile multimedia clustered ad hoc networks
The handbook of ad hoc wireless networks
On the performance of parallel factorization of out-of-core matrices
Parallel Computing
Graph visualization for the analysis of the structure and dynamics of extreme-scale supercomputers
Information Visualization - Special issue: Software visualization
MAPFS: a flexible multiagent parallel file system for clusters
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
Taming the memory hogs: using compiler-inserted releases to manage physical memory intelligently
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
An efficient delay-optimal distributed termination detection algorithm
Journal of Parallel and Distributed Computing
MAPFS: A flexible multiagent parallel file system for clusters
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
DataSpaces: an interaction and coordination framework for coupled simulation workflows
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
The practice of i/o optimizations for out-of-core computation
PDCAT'04 Proceedings of the 5th international conference on Parallel and Distributed Computing: applications and Technologies
Robotics and Computer-Integrated Manufacturing
ISPA'07 Proceedings of the 5th international conference on Parallel and Distributed Processing and Applications
Scalable model of parallel computations for applications with intensive input-output
Journal of Computer and Systems Sciences International
Hi-index | 4.10 |
Over the past two decades (1974-94), advances in semiconductor and integrated circuit technology have fuelled the drive toward faster, ever more efficient computational machines. Today, the most powerful supercomputers can perform computation at billions of floating-point operations per second (gigaflops). This increase in capability is intensifying the demand for even more powerful machines. Computational limits for the largest supercomputers are expected to exceed the teraflops barrier in the coming years. Discussion is given on the following areas: the nature of I/O in massive parallel processing; operating and file systems; runtime system and compilers; and networking technology. The recurrent themes in the parallel I/O problem are the existence of a great variety in access patterns and the sensitivity of current I/O systems to these access patterns. An increase in the variability of access patterns is also expected, and single resource-management approaches will likely not suffice. Providing the I/O infrastructure that will support these requirements will necessitate research in operating systems (parallel file systems, runtime systems, and drivers), language interfaces to high-performance storage systems, high-speed networking, graphics and visualization systems, and new hardware technology for I/O and storage systems.