ACM Transactions on Computer Systems (TOCS)
Andrew: a distributed personal computing environment
Communications of the ACM - The MIT Press scientific computation series
The Sprite Network Operating System
Computer
Coda: A Highly Available File System for a Distributed Workstation Environment
IEEE Transactions on Computers
Techniques for file system simulation
Software—Practice & Experience
The Vesta parallel file system
ACM Transactions on Computer Systems (TOCS)
RAMA: an easy-to-use, high-performance parallel file system
Parallel Computing - Special double issue: parallel I/O
A cost-effective, high-bandwidth storage architecture
Proceedings of the eighth international conference on Architectural support for programming languages and operating systems
Directory Reference Patterns in Hierarchical File Systems
IEEE Transactions on Knowledge and Data Engineering
GPFS: A Shared-Disk File System for Large Computing Clusters
FAST '02 Proceedings of the Conference on File and Storage Technologies
zFS " A Scalable Distributed File System Using Object Disks
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Reliability Mechanisms for Very Large Storage Systems
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Efficient Metadata Management in Large Distributed Storage Systems
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
File system design for an NFS file server appliance
WTEC'94 Proceedings of the USENIX Winter 1994 Technical Conference on USENIX Winter 1994 Technical Conference
A comparison of file system workloads
ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference
Scalability in the XFS file system
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Embedded inodes and explicit grouping: exploiting disk bandwidth for small files
ATEC '97 Proceedings of the annual conference on USENIX Annual Technical Conference
Secure capabilities for a petabyte-scale object-based distributed file system
Proceedings of the 2005 ACM workshop on Storage security and survivability
Ceph: a scalable, high-performance distributed file system
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
Distributed directory service in the Farsite file system
OSDI '06 Proceedings of the 7th symposium on Operating systems design and implementation
Proceedings of the 2008 ACM/IEEE conference on Supercomputing
Directory-Based Metadata Optimizations for Small Files in PVFS
Euro-Par '08 Proceedings of the 14th international Euro-Par conference on Parallel Processing
Deconstructing Network Attached Storage systems
Journal of Network and Computer Applications
Symmetric active/active metadata service for high availability parallel file systems
Journal of Parallel and Distributed Computing
MHS: A distributed metadata management strategy
Journal of Systems and Software
Adaptive and scalable metadata management to support a trillion files
Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
Clustering metadata servers for extremely scalable and reliable services
ICACT'09 Proceedings of the 11th international conference on Advanced Communication Technology - Volume 3
Finding a needle in Haystack: facebook's photo storage
OSDI'10 Proceedings of the 9th USENIX conference on Operating systems design and implementation
Scale and concurrency of GIGA+: file system directories with millions of files
FAST'11 Proceedings of the 9th USENIX conference on File and stroage technologies
PetaShare: A reliable, efficient and transparent distributed storage management system
Scientific Programming
Pantheon: exascale file system search for scientific computing
SSDBM'11 Proceedings of the 23rd international conference on Scientific and statistical database management
CEFLS: A Cost-Effective File Lookup Service in a Distributed Metadata File System
CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Proceedings of the 2nd International Workshop on Runtime and Operating Systems for Supercomputers
A dynamic and adaptive load balancing strategy for parallel file system with large-scale I/O servers
Journal of Parallel and Distributed Computing
A fast indexing algorithm optimization with user behavior pattern
ICPCA/SWS'12 Proceedings of the 2012 international conference on Pervasive Computing and the Networked World
Two-level Hash/Table approach for metadata management in distributed file systems
The Journal of Supercomputing
Network-aware data caching and prefetching for cloud-hosted metadata retrieval
NDM '13 Proceedings of the Third International Workshop on Network-Aware Data Management
Performance and scalability evaluation of the Ceph parallel file system
PDSW '13 Proceedings of the 8th Parallel Data Storage Workshop
Scalable Metadata Management Through OSD+ Devices
International Journal of Parallel Programming
| Hi-index | 0.00 |
In petabyte-scale distributed file systems that decouple read and write from metadata operations, behavior of the metadata server cluster will be critical to overall system performance and scalability. We present a dynamic subtree partitioning and adaptive metadata management system designed to efficiently manage hierarchical metadata workloads that evolve over time. We examine the relative merits of our approach in the context of traditional workload partitioning strategies, and demonstrate the performance, scalability and adaptability advantages in a simulation environment.