Enabling Lustre WAN for production use on the TeraGrid: a lightweight UID mapping scheme

Authors:
Joshua Walgenbach;Stephen C. Simms;Kit Westneat;Justin P. Miller
Affiliations:
Indiana University, Bloomington, IN;Indiana University, Bloomington, IN;Data Direct Networks, Chatsworth, CA;Indiana University, Bloomington, IN
Venue:
Proceedings of the 2010 TeraGrid Conference
Year:
2010

Citing 2
Cited 4

Massive High-Performance Global File Systems for Grid computing

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Empowering distributed workflow with the data capacitor: maximizing lustre performance across the wide area network

Proceedings of the 2007 workshop on Service-oriented computing performance: aspects, issues, and approaches

What is cyberinfrastructure

Proceedings of the 38th annual ACM SIGUCCS fall conference: navigation and discovery
Performance and quality of service of data and video movement over a 100 Gbps testbed

Future Generation Computer Systems
Demonstrating lustre over a 100Gbps wide area network of 3,500km

SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
A classification of file placement and replication methods on grids

Future Generation Computer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

The Indiana University Data Capacitor wide area Lustre file system provides over 350 TB of short- to mid-term storage of large research data sets. It spans multiple geographically distributed compute, storage, and visualization resources. In order to effectively harness the power of these resources from various institutions, it has been necessary to develop software to keep ownership and permission data consistent across many client mounts. This paper describes the Data Capacitor's Lustre WAN service and the history, development, and implementation of IU's UID mapping scheme that enables Lustre WAN on the TeraGrid.