Scale and performance in a distributed file system
ACM Transactions on Computer Systems (TOCS)
Managing AFS: the Andrew File System
Managing AFS: the Andrew File System
Solaris Internals (2nd Edition)
Solaris Internals (2nd Edition)
Data ONTAP GX: a scalable storage cluster
FAST '07 Proceedings of the 5th USENIX conference on File and Storage Technologies
Scalability in the XFS file system
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
| Hi-index | 0.00 |
The performance of metadata processing in large distributed file systems currently presents larger challenges than scaling of data throughput. The paper presents a novel, distributed benchmark called DMetabench for measuring the performance of metadata operations. DMetabench runs in environments with potentially thousands of nodes and allows an assessment of the scalability of metadata operations. Additionally, precise run-time performance data is preserved which allows for a better understanding of performance artifacts. Example results from production file systems are provided and discussed. Possible applications of knowledge about metadata performance scaling include the choice of an optimal parallelization strategy for metadata-intensive workloads in a specific runtime environment.