File declustering for efficient parallel I/O on networks of workstations

Authors:
Hau-Yang Cheng;Chung-Ta King
Affiliations:
Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan;Department of Computer Science, National Tsing Hua University, Hsinchu, Taiwan
Venue:
Cluster computing
Year:
2001

Citing 11
Cited 0

An Evaluation of Multiple-Disk I/O Systems

IEEE Transactions on Computers
Design and Evaluation of primitives for Parallel I/O

Proceedings of the 1993 ACM/IEEE conference on Supercomputing
The Zebra striped network file system

ACM Transactions on Computer Systems (TOCS)
Flexibility and performance of parallel file systems

ACM SIGOPS Operating Systems Review
The Vesta parallel file system

ACM Transactions on Computer Systems (TOCS)
Parallel array object I/O support on distributed environments

Journal of Parallel and Distributed Computing
Characterizing concurrency control performance for the PIOUS parallel file system

Journal of Parallel and Distributed Computing
Maximizing performance in a striped disk array

ISCA '90 Proceedings of the 17th annual international symposium on Computer Architecture
Disk Striping

Proceedings of the Second International Conference on Data Engineering
An Expression-Rewriting Framework to Generate Communication Sets for HPF Programs with Block-Cyclic Distribution

IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium
USING DATA STRIPING IN A LOCAL AREA NETWORK

USING DATA STRIPING IN A LOCAL AREA NETWORK

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the issues involved in selecting an appropriate file declustering method to serve various access patterns on distributed parallel computing environments. A good file declustering method for multiple access patterns must (1) maximize the overall local access ratio, (2) minimize the performance variance between the access patterns, and (3) balance disk loads. The variable striping file declustering (VSFD) method is proposed for optimizing the file allocation in the I/O nodes with multiple access patterns and can increase the local access ratio. In addition, VSFD can provide uniform and consistent performance across different access patterns, because it is able to induce the smallest variance in local disk access ratios for different access patterns.