Increasing distributed storage survivability with a stackable RAID-like file system

Authors:
N. Joukov;A. Rai;E. Zadok
Affiliations:
State Univ. of New York, Stony Brook, NY, USA;State Univ. of New York, Stony Brook, NY, USA;State Univ. of New York, Stony Brook, NY, USA
Venue:
CCGRID '05 Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid - Volume 01
Year:
2005

Citing 0
Cited 7

On incremental file system development

ACM Transactions on Storage (TOS)
Accurate and efficient replaying of file system traces

FAST'05 Proceedings of the 4th conference on USENIX Conference on File and Storage Technologies - Volume 4
The design and implementation of an extensible network backup system in realtime

Proceedings of the 3rd International Conference on Ubiquitous Information Management and Communication
ATTEST: ATTributes-based Extendable STorage

Journal of Systems and Software
Tolerating file-system mistakes with EnvyFS

USENIX'09 Proceedings of the 2009 conference on USENIX Annual technical conference
Fast and cautious evolution of cloud storage

HotStorage'10 Proceedings of the 2nd USENIX conference on Hot topics in storage and file systems
Implementation of a stackable file system for real-time network backup

International Journal of Autonomic Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have designed a stackable file system called Redundant Array of Independent Filesystems (RAIF). It combines the data survivability properties and performance benefits of traditional RAIDs with the unprecedented flexibility of composition, improved security, and ease of development of stackable file systems. RAIF can be mounted on top of any combination of other file systems including network, distributed, disk-based, and memory-based file systems. Existing encryption, compression, antivirus, and consistency checking stackable file systems can be mounted above and below RAIF, to efficiently cope up with slow or unsecure branches. Individual files can be distributed across branches, replicated, stored with parity, or stored with erasure correction coding to recover from failures on multiple branches. Per-file incremental recovery, storage type migration, and load-balancing are especially well suited for grid storages. In this paper, we describe the current RAIF design, provide preliminary performance results and discuss current status and future directions.