A comparative experimental study of parallel file systems for large-scale data processing
LASCO'08 First USENIX Workshop on Large-Scale Computing
Analysis of the MPI-IO optimization levels with the PIOViz Jumpshot enhancement
PVM/MPI'07 Proceedings of the 14th European conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Two-level Hash/Table approach for metadata management in distributed file systems
The Journal of Supercomputing
Hi-index | 0.00 |
As the complexity of parallel file systems' software stacks increases it gets harder to reveal the reasons for performance bottlenecks in these software layers. This paper introduces a method which eliminates the influence of the physical storage on performance analysis in order to find these bottlenecks. Also, the influence of the hardware components on the performance is modeled to estimate the maximum achievable performance of a parallel file system. The paper focusses on the Parallel Virtual File System 2 (PVFS2) and shows results for the functionality file creation, small contiguous I/O requests and large contiguous I/O requests.