Scale and performance in a distributed file system
ACM Transactions on Computer Systems (TOCS)
Spritely NFS: experiments with cache-consistency protocols
SOSP '89 Proceedings of the twelfth ACM symposium on Operating systems principles
Coda: A Highly Available File System for a Distributed Workstation Environment
IEEE Transactions on Computers
OceanStore: an architecture for global-scale persistent storage
ASPLOS IX Proceedings of the ninth international conference on Architectural support for programming languages and operating systems
A low-bandwidth network file system
SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
GPFS: A Shared-Disk File System for Large Computing Clusters
FAST '02 Proceedings of the Conference on File and Storage Technologies
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Exporting Storage Systems in a Scalable Manner with pNFS
MSST '05 Proceedings of the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies
Farsite: federated, available, and reliable storage for an incompletely trusted environment
OSDI '02 Proceedings of the 5th symposium on Operating systems design and implementationCopyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading
MapReduce: simplified data processing on large clusters
OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Not quite NFS, soft cache consistency for NFS
WTEC'94 Proceedings of the USENIX Winter 1994 Technical Conference on USENIX Winter 1994 Technical Conference
Resolving file conflicts in the Ficus file system
USTC'94 Proceedings of the USENIX Summer 1994 Technical Conference on USENIX Summer 1994 Technical Conference - Volume 1
Cooperative caching: using remote client memory to improve file system performance
OSDI '94 Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation
NSDI'06 Proceedings of the 3rd conference on Networked Systems Design & Implementation - Volume 3
Nache: design and implementation of a caching proxy for NFSv4
FAST '07 Proceedings of the 5th USENIX conference on File and Storage Technologies
Anatomy of a cortical simulator
Proceedings of the 2007 ACM/IEEE conference on Supercomputing
Scalable performance of the Panasas parallel file system
FAST'08 Proceedings of the 6th USENIX Conference on File and Storage Technologies
TierStore: a distributed filesystem for challenged networks in developing regions
FAST'08 Proceedings of the 6th USENIX Conference on File and Storage Technologies
The Bayou Architecture: Support for Data Sharing Among Mobile Users
WMCSA '94 Proceedings of the 1994 First Workshop on Mobile Computing Systems and Applications
Towards scalable I/O architecture for exascale systems
Proceedings of the 2011 ACM international workshop on Many task computing on grids and supercomputers
A dynamic and adaptive load balancing strategy for parallel file system with large-scale I/O servers
Journal of Parallel and Distributed Computing
Zone-based data striping for cloud storage
IBM Journal of Research and Development
GPFS-SNC: an enterprise storage framework for virtual-machine clouds
IBM Journal of Research and Development
Hi-index | 0.00 |
Cloud computing promises large-scale and seamless access to vast quantities of data across the globe. Applications will demand the reliability, consistency, and performance of a traditional cluster file system regardless of the physical distance between data centers. Panache is a scalable, high-performance, clustered file system cache for parallel data-intensive applications that require wide area file access. Panache is the first file system cache to exploit parallelism in every aspect of its design--parallel applications can access and update the cache from multiple nodes while data and metadata is pulled into and pushed out of the cache in parallel. Data is cached and updated using pNFS, which performs parallel I/O between clients and servers, eliminating the single-server bottleneck of vanilla client-server file access protocols. Furthermore, Panache shields applications from fluctuating WAN latencies and outages and is easy to deploy as it relies on open standards for high-performance file serving and does not require any proprietary hardware or software to be installed at the remote cluster. In this paper, we present the overall design and implementation of Panache and evaluate its key features with multiple workloads across local and wide area networks.