A hierarchical parallel storage system based on distributed memory for large scale systems

Authors:
Francisco Rodrigo Duro;Javier Garcia Blas;Jesus Carretero
Affiliations:
University Carlos III, Leganes, Spain;University Carlos III, Leganes, Spain;University Carlos III, Leganes, Spain
Venue:
Proceedings of the 20th European MPI Users' Group Meeting
Year:
2013

Citing 5
Cited 0

Distributed caching with memcached

Linux Journal
Petascale Computational Systems

Computer
The International Exascale Software Project roadmap

International Journal of High Performance Computing Applications
Design and Evaluation of Multiple-Level Data Staging for Blue Gene Systems

IEEE Transactions on Parallel and Distributed Systems
Disk-locality in datacenter computing considered irrelevant

HotOS'13 Proceedings of the 13th USENIX conference on Hot topics in operating systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents the design and implementation of a storage system for high performance systems based on a multiple level I/O caching architecture. The solution relies on Memcached as a parallel storage system, preserving its powerful capacities such as transparency, quick deployment, and scalability. The designed parallel storage system targets to reduce the I/O latency in data-intensive high performance applications. The proposed solution consists of a user-level library and extended Memcached servers. The solution aims to be hierarchical by deploying Memcached-based I/O servers across all the infrastructure data path. Our experiments demonstrate that our solution is up to 40% faster than PVFS2.