A Decentralized Storage Cluster with High Reliability and Flexibility

  • Authors:
  • Changsheng Xie;Bin Cai

  • Affiliations:
  • Huazhong University of Science and Technology. Wuhan, China;Huazhong University of Science and Technology. Wuhan, China

  • Venue:
  • PDP '06 Proceedings of the 14th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Decentralized, cooperative and large-scale distributed storage systems that consist of a cluster of storage nodes attached with local disks can deliver high resource utilization, high availability and easy scalability. Therefore they become a cost-eflective solution. High availability with node failures, strong data consistency, flexible expandability and high 110 throughput are still important challenges in the face of the system design. In this paper, we describe the design and implementation of a LAN-based decentralized storage cluster built upon off-the-shelf commodity components. It employs replication and Erasure-codes to provide high reliability and automatic failure recovev, adopts versioning to achieve single-file serializability and replicas consistency, supports data migration scheme to balance I/O workload and storage utilization, and provides global unified content cache to optimize memory-to-disk policy. We also present the experiment results to demonstrate the features and performance of our design.