Scale and performance in a distributed file system
ACM Transactions on Computer Systems (TOCS)
Caching in the Sprite network file system
ACM Transactions on Computer Systems (TOCS)
Measurements of a distributed file system
SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
Serverless network file systems
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
Implementing global memory management in a workstation cluster
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
Sun MPII/O: efficient I/O for parallel applications
SC '99 Proceedings of the 1999 ACM/IEEE conference on Supercomputing
Hint-based cooperative caching
ACM Transactions on Computer Systems (TOCS)
PVFS: A Parallel Virtual File System for Linux Clusters
Linux Journal
GPFS: A Shared-Disk File System for Large Computing Clusters
FAST '02 Proceedings of the Conference on File and Storage Technologies
Cache Fusion: Extending Shared-Disk Clusters with Shared Caches
Proceedings of the 27th International Conference on Very Large Data Bases
HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
Global memory management for workstation networks
Global memory management for workstation networks
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Cooperative caching: using remote client memory to improve file system performance
OSDI '94 Proceedings of the 1st USENIX conference on Operating Systems Design and Implementation
Striping cache: a global cache for striped network file system
ACSAC'06 Proceedings of the 11th Asia-Pacific conference on Advances in Computer Systems Architecture
Hi-index | 0.00 |
A common file access pattern found in cluster applications is concurrent read sharing: applications running on multiple sites read access the same data set concurrently. Traditional network file systems are limited by the server's network bandwidth; therefore, it cannot satisfy the high-bandwidth concurrent reads that cluster applications typically require. This paper presents NFS-cc; a cooperative caching file system based on NFS and optimised for concurrent read sharing. Cooperative caching used by NFS-cc is a distributed file caching scheme, which allows file system clients to read data from the memory of other clients, instead of the server. If multiple clients cache the same data, they can supply the data to other clients concurrently, which greatly reduces the contention for the server's network bandwidth. NFS-cc exploits clients' bandwidth and file caches to improve the aggregate read throughput of the file system. Our preliminary performance measurements show that the aggregate read throughput of NFS-cc was increased with the number of clients and reached as high as 42.6 MB/s with 12 clients connected by a fast Ethernet. NFS-cc also reduced the average block read time by a factor of 50 80% under a variety of concurrent read access patterns when compared with NFS.