A Storage Space Management Policy for a Cluster File System

Authors:
Jin Xiong;Rongfeng Tang;Zhihua Fan;Hui Li;Jie Ma;Dan Meng;Ninghui Sun
Affiliations:
Graduate School of Chinese Academy of Sciences, China;Graduate School of Chinese Academy of Sciences, China;Graduate School of Chinese Academy of Sciences, China;Graduate School of Chinese Academy of Sciences, China;Institute of Computing Technology, Chinese Academy of Sciences, China;Institute of Computing Technology, Chinese Academy of Sciences, China;Institute of Computing Technology, Chinese Academy of Sciences, China
Venue:
HPCASIA '05 Proceedings of the Eighth International Conference on High-Performance Computing in Asia-Pacific Region
Year:
2005

Citing 7
Cited 0

The ITC distributed file system: principles and design

Proceedings of the tenth ACM symposium on Operating systems principles
GPFS: A Shared-Disk File System for Large Computing Clusters

FAST '02 Proceedings of the Conference on File and Storage Technologies
IBM Storage Tank-- A heterogeneous scalable SAN file system

IBM Systems Journal
Internet Protocol storage area networks

IBM Systems Journal
Scalability in the XFS file system

ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Scalability and failure recovery in a linux cluster file system

ALS'00 Proceedings of the 4th annual Linux Showcase & Conference - Volume 4
PVFS: a parallel file system for linux clusters

ALS'00 Proceedings of the 4th annual Linux Showcase & Conference - Volume 4

Quantified Score

Hi-index	0.00

Visualization

Abstract

The major challenge in designing cluster file systems is to provide high aggregate I/O bandwidth and high metadata processing throughput for applications running on large-scale cluster systems. And with the rapid increase of required data storage, how to improve access performance of a PB-scale cluster file system is also a challenging issue. In this paper, we introduce the storage space management policy for a PB-scale cluster file system. Our performance results showed that compared with Lustre and GFS, DCFS2 is able to provide comparable or even better aggregate I/O bandwidth.