Striping without sacrifices: maintaining POSIX semantics in a parallel file system

Authors:
Jan Stender;Björn Kolbeck;Felix Hupfeld;Eugenio Cesario;Erich Focht;Matthias Hess;Jesús Malo;Jonathan Martí
Affiliations:
Zuse Institute Berlin, Berlin, Germany;Zuse Institute Berlin, Berlin, Germany;Zuse Institute Berlin, Berlin, Germany;Institute High Performance Computing and Networks of the National Research Council of Italy, Rende, CS, Italy;NEC HPC Europe GmbH, Stuttgart, Germany;NEC HPC Europe GmbH, Stuttgart, Germany;Barcelona Supercomputing Center, Barcelona, Spain;Barcelona Supercomputing Center, Barcelona, Spain
Venue:
LASCO'08 First USENIX Workshop on Large-Scale Computing
Year:
2008

Citing 9
Cited 0

Measurements of a distributed file system

SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
A trace-driven analysis of the UNIX 4.2 BSD file system

Proceedings of the tenth ACM symposium on Operating systems principles
A high-performance distributed parallel file system for data-intensive computations

Journal of Parallel and Distributed Computing
GPFS: A Shared-Disk File System for Large Computing Clusters

FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Ceph: a scalable, high-performance distributed file system

OSDI '06 Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation - Volume 7
A comparison of file system workloads

ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference
PVFS: a parallel file system for linux clusters

ALS'00 Proceedings of the 4th annual Linux Showcase & Conference - Volume 4
Object storage: the future building block for storage systems

LGDI '05 Proceedings of the 2005 IEEE International Symposium on Mass Storage Systems and Technology
Object-based storage

IEEE Communications Magazine

Quantified Score

Hi-index	0.00

Visualization

Abstract

Striping is a technique that distributes file content over multiple storage servers and thereby enables parallel access. In order to be able to provide a consistent view across file data and metadata operations, the file system has to track the layout of the file and know where the file ends and where it contains gaps. In this paper, we present a light-weight protocol for maintaining a consistent notion of a file's layout that provides POSIX semantics without restricting concurrent access to the file. In an evaluation, we show that the protocol scales and elicit its corner cases.