Programming languages for distributed computing systems
ACM Computing Surveys (CSUR)
Parallel database systems: the future of high performance database systems
Communications of the ACM
A comparative study of five parallel programming languages
Future Generation Computer Systems - Special triple issue: parallel and distributed workstation systems
The Vesta parallel file system
ACM Transactions on Computer Systems (TOCS)
File-Access Characteristics of Parallel Scientific Workloads
IEEE Transactions on Parallel and Distributed Systems
Dummynet: a simple approach to the evaluation of network protocols
ACM SIGCOMM Computer Communication Review
The grid: blueprint for a new computing infrastructure
The grid: blueprint for a new computing infrastructure
Cluster I/O with River: making the fast case common
Proceedings of the sixth workshop on I/O in parallel and distributed systems
External memory algorithms
Fostering and assessing communication skills in the computer science context
Proceedings of the thirty-first SIGCSE technical symposium on Computer science education
Armada: a parallel I/O framework for computational grids
Future Generation Computer Systems - Best papers from symp. on cluster computing and the grid (CCGRID 2001)
ACM Transactions on Computer Systems (TOCS)
GAMMA - A High Performance Dataflow Database Machine
VLDB '86 Proceedings of the 12th International Conference on Very Large Data Bases
Parallel Algorithms for Series Parallel Graphs
ESA '96 Proceedings of the Fourth Annual European Symposium on Algorithms
Executing multiple pipelined data analysis operations in the grid
Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Armada: A Parallel File System for Computational Grids
CCGRID '01 Proceedings of the 1st International Symposium on Cluster Computing and the Grid
ViC*: A Compiler for Virtual-Memory C*
HIPS '98 Proceedings of the High-Level Parallel Programming Models and Supportive Environments
dQUOB: Managing Large Data Flows Using Dynamic Embedded Queries
HPDC '00 Proceedings of the 9th IEEE International Symposium on High Performance Distributed Computing
Distributed Computing with Load-Managed Active Storage
HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Efficient i/o for computational grid applications
Efficient i/o for computational grid applications
An integrated experimental environment for distributed systems and networks
OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
| Hi-index | 0.00 |
High-performance computing increasingly occurs on "computational grids" composed of heterogeneous and geographically distributed systems of computers, networks, and storage devices that collectively act as a single "virtual" computer. A key challenge in this environment is to provide efficient access to data distributed across remote data servers. Our parallel I/O framework, called Armada, allows application and data-set providers to flexibly compose graphs of processing modules that describe the distribution, application interfaces, and processing required of the dataset before computation. Although the framework provides a simple programming model for the application programmer and the data-set provider, the resulting graph may contain bottlenecks that prevent efficient data access. In this paper, we present an algorithm used to restructure Armada graphs that distributes computation and data flow to improve performance in the context of a wide-area computational grid.