A windows-based parallel file system

Authors:
Lungpin Yeh;Juei-Ting Sun;Sheng-Kai Hung;Yarsun Hsu
Affiliations:
Department of Electrical Engineering, National Tsing Hua University, HsinChu, Taiwan;Department of Electrical Engineering, National Tsing Hua University, HsinChu, Taiwan;Department of Electrical Engineering, National Tsing Hua University, HsinChu, Taiwan;Department of Electrical Engineering, National Tsing Hua University, HsinChu, Taiwan
Venue:
HPCC'07 Proceedings of the Third international conference on High Performance Computing and Communications
Year:
2007

Citing 6
Cited 0

Performance of the Vesta parallel file system

IPPS '95 Proceedings of the 9th International Symposium on Parallel Processing
An overview of the BlueGene/L Supercomputer

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
Implementation and performance of a parallel file system for high performance distributed applications

HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
Implementing CIFS: The Common Internet File System

Implementing CIFS: The Common Internet File System
Microsoft Windows Internals, Fourth Edition: Microsoft Windows Server(TM) 2003, Windows XP, and Windows 2000 (Pro-Developer)

Microsoft Windows Internals, Fourth Edition: Microsoft Windows Server(TM) 2003, Windows XP, and Windows 2000 (Pro-Developer)
PVFS: a parallel file system for linux clusters

ALS'00 Proceedings of the 4th annual Linux Showcase & Conference - Volume 4

Quantified Score

Hi-index	0.00

Visualization

Abstract

Parallel file systems are widely used in clusters to provide high performance I/O. However, most of the existing parallel file systems are based on UNIX-like operating systems. We use the Microsoft .NET framework to implement a parallel file system for Windows. We also implement a file system driver to support existing applications written with Win32 APIs. In addition, a preliminary MPI-IO library is also developed. Applications using MPI-IO could achieve the best performance using our parallel file system, while the existing binaries could benefit from the system driver without any modifications. In this paper, the design and implementation of our system are described. File system performance using our preliminary MPI-IO library and system driver is also evaluated. The results show that the performance is scalable and limited by the network bandwidth.