Performance measurement of the concurrent file system of the Intel iPSC/2 hypercube
Journal of Parallel and Distributed Computing - Special issue on parallel I/O systems
Proceedings of the Second International Conference on Data Engineering
xDGDL: towards an XML-based datagrid description language
High performance scientific and engineering computing
Using Grid Computing and PVFS2 Technologies for Construction of an e-Learning Environment
ICALT '05 Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies
CEFT: A cost-effective, fault-tolerant parallel virtual file system
Journal of Parallel and Distributed Computing
SNAPI '03 Proceedings of the international workshop on Storage network architecture and parallel I/Os
Modeling and improving security of a local disk system for write-intensive workloads
ACM Transactions on Storage (TOS)
Supporting data management on cluster grids
Future Generation Computer Systems
NFS-cc: tuning NFS for concurrent read sharing
International Journal of High Performance Computing and Networking
Evaluating structured I/O methods for parallel file systems
International Journal of High Performance Computing and Networking
Study of content-based image retrieval using parallel computing technique
CHINA HPC '07 Proceedings of the 2007 Asian technology information program's (ATIP's) 3rd workshop on High performance computing in China: solution approaches to impediments for high performance computing
Conserving energy in real-time storage systems with I/O burstiness
ACM Transactions on Embedded Computing Systems (TECS)
Scientific workflows and clouds
Crossroads - Plugging Into the Cloud
Disks are like snowflakes: no two are alike
HotOS'13 Proceedings of the 13th USENIX conference on Hot topics in operating systems
A cost-intelligent application-specific data layout scheme for parallel file systems
Proceedings of the 20th international symposium on High performance distributed computing
Server-side I/O coordination for parallel file systems
Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis
Hint controlled distribution with parallel file systems
PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Evaluation of I/O technologies on a flash-based I/O sub-system for HPC
Proceedings of the 1st Workshop on Architectures and Systems for Big Data
A windows-based parallel file system
HPCC'07 Proceedings of the Third international conference on High Performance Computing and Communications
Evaluating cloud storage services for tightly-coupled applications
Euro-Par'12 Proceedings of the 18th international conference on Parallel processing workshops
| Hi-index | 0.00 |
Dedicated cluster parallel computers (DCPCs) are emerging as low-cost high performance environments for many important applications in science and engineering. A significant class of applications that perform well on a DCPC are coarse-grain applications that involve large amounts of file I/O. Current research in parallel file systems for distributed systems is providing a mechanism for adapting these applications to the DCPC environment. We present the Parallel Virtual File System (PVFS), a system that provides disk striping across multiple nodes in a distributed parallel computer and file partitioning among tasks in a parallel program. PVFS is unique among similar systems in that it uses a stream-based approach that represents each file access with a single set of request parameters and decouples the number of network messages from details of the file striping and partitioning. PVFS also provides support for efficient collective file accesses and allows overlapping file partitions. We present results of early performance experiments that show PVFS achieves excellent speedups in accessing moderately sized file segments.