enabling cross-layer optimizations in storage systems with custom metadata

Authors:
Elizeu Santos-Neto;Samer Al-Kiswany;Nazareno Andrade;Sathish Gopalakrishnan;Matei Ripeanu
Affiliations:
University of British Columbia, Vancouver, BC, Canada;University of British Columbia, Vancouver, BC, Canada;Universidade Federal de Campina Grande, Campina Grande, Brazil and Universite of British Columbia, Vancouver, BC, Canada;University of British Columbia, Vancouver, BC, Canada;University of British Columbia, Vancouver, BC, Canada
Venue:
HPDC '08 Proceedings of the 17th international symposium on High performance distributed computing
Year:
2008

Citing 14
Cited 1

Semantic file systems

SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
Haystack: per-user information environments

Proceedings of the eighth international conference on Information and knowledge management
Heuristics for Scheduling Parameter Sweep Applications in Grid Environments

HCW '00 Proceedings of the 9th Heterogeneous Computing Workshop
Lifetime packet discard for efficient real-time transport over cellular links

ACM SIGMOBILE Mobile Computing and Communications Review
Modeling wireless links for transport protocols

ACM SIGCOMM Computer Communication Review
Optimal File-Bundle Caching Algorithms for Data-Grids

Proceedings of the 2004 ACM/IEEE conference on Supercomputing
A Metadata Catalog Service for Data Intensive Applications

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Richer File System Metadata Using Links and Attributes

MSST '05 Proceedings of the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies
A survey of data provenance in e-science

ACM SIGMOD Record
Scheduling strategies for mapping application workflows onto the grid

HPDC '05 Proceedings of the High Performance Distributed Computing, 2005. HPDC-14. Proceedings. 14th IEEE International Symposium
Falkon: a Fast and Light-weight tasK executiON framework

Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Searching and navigating petabyte-scale file systems based on facets

PDSW '07 Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07
Exploiting replication and data reuse to efficiently schedule data-intensive applications on grids

JSSPP'04 Proceedings of the 10th international conference on Job Scheduling Strategies for Parallel Processing
System Architecture and Cross-Layer Optimization of Video Broadcast over WiMAX

IEEE Journal on Selected Areas in Communications

Cashing in on hints for better prefetching and caching in PVFS and MPI-IO

Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Today, several data-storage systems allow applications to create and manage custom metadata to improve data search and navigability in large scale storage systems. Our thesis is that, besides improving search and navigability, custom metadata can also serve as a two way communication mechanism between applications and the storage layer to enable cross-layer optimizations in a uniform, application-independent and incremental fashion.