The XtreemFS architecture—a case for object-based file systems in Grids

Authors:
Felix Hupfeld;Toni Cortes;Björn Kolbeck;Jan Stender;Erich Focht;Matthias Hess;Jesus Malo;Jonathan Marti;Eugenio Cesario
Affiliations:
Zuse Institute Berlin (ZIB), Takustr. 7, 14195 Berlin, Germany;Barcelona Supercomputing Center (BSC), Barcelona, Spain and Universitat Politecnica de Catalunya (UPC), Spain;Zuse Institute Berlin (ZIB), Takustr. 7, 14195 Berlin, Germany;Zuse Institute Berlin (ZIB), Takustr. 7, 14195 Berlin, Germany;NEC HPC Europe GmbH, Stuttgart, Germany;NEC HPC Europe GmbH, Stuttgart, Germany;Barcelona Supercomputing Center (BSC), Barcelona, Spain;Barcelona Supercomputing Center (BSC), Barcelona, Spain;Institute High Performance Computing and Networks of the National Research Council of Italy (ICAR-CNR), Pisa, Italy
Venue:
Concurrency and Computation: Practice & Experience - Selection of Best Papers of the VLDB Data Management in Grids Workshop (VLDB DMG 2007)
Year:
2008

Citing 0
Cited 17

A Sharable Storage Service for Distributed Computing Systems in Combination of Remote and Local Storage

ICA3PP '09 Proceedings of the 9th International Conference on Algorithms and Architectures for Parallel Processing
The Architecture of the XtreemOS Grid Checkpointing Service

Euro-Par '09 Proceedings of the 15th International Euro-Par Conference on Parallel Processing
Data Sharing Options for Scientific Workflows on Amazon EC2

Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis
What Is the price of simplicity? a cross-platform evaluation of the SAGA API

EuroPar'10 Proceedings of the 16th international Euro-Par conference on Parallel processing: Part I
BlobSeer: Next-generation data management for large scale infrastructures

Journal of Parallel and Distributed Computing
Snooze: A Scalable, Fault-Tolerant and Distributed Consolidation Manager for Large-Scale Clusters

GREENCOM-CPSCOM '10 Proceedings of the 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing
VizLitG: Grid Visualization e-Service Enabling Partial Dataset Transfer from Storage Elements of gLite-based Grid Infrastructure

Journal of Grid Computing
ConPaaS: an integrated runtime environment for elastic cloud applications

Proceedings of the Workshop on Posters and Demos Track
An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2

Journal of Grid Computing
Designing data storage tier using Integer Programing

Proceedings of the 27th Annual ACM Symposium on Applied Computing
Consistency and fault tolerance for erasure-coded distributed storage systems

Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date
Independent checkpointing in a heterogeneous grid environment

Future Generation Computer Systems
A look to the old-world_sky: EU-funded dependability cloud computing research

ACM SIGOPS Operating Systems Review
MR-search: massively parallel heuristic search

Concurrency and Computation: Practice & Experience
A Single Sign-On Infrastructure for Science Gateways on a Use Case for Structural Bioinformatics

Journal of Grid Computing
Content-based chunk placement scheme for decentralized deduplication on distributed file systems

ICCSA'13 Proceedings of the 13th international conference on Computational Science and Its Applications - Volume 1
Beyond IaaS and PaaS: An Extended Cloud Taxonomy for Computation, Storage and Networking

UCC '13 Proceedings of the 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In today's Grids, files are usually managed by Grid data management systems that are superimposed on existing file and storage systems. In this paper, we analyze this predominant approach and argue that object-based file systems can be an alternative when adapted to the characteristics of a Grid environment. We describe how we are solving the challenge of extending the object-based storage architecture for the Grid in XtreemFS, an object-based file system for federated infrastructures. Copyright © 2008 John Wiley & Sons, Ltd.