The design and implementation of a log-structured file system
ACM Transactions on Computer Systems (TOCS)
Performance analysis of the RIO multimedia storage system with heterogeneous disk configurations
MULTIMEDIA '98 Proceedings of the sixth ACM international conference on Multimedia
DualFS: a new journaling file system without meta-data duplication
ICS '02 Proceedings of the 16th international conference on Supercomputing
Compact, adaptive placement schemes for non-uniform requirements
Proceedings of the fourteenth annual ACM symposium on Parallel algorithms and architectures
A study of file sizes and functional lifetimes
SOSP '81 Proceedings of the eighth ACM symposium on Operating systems principles
Efficient Metadata Management in Large Distributed Storage Systems
MSS '03 Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03)
Characterizing Reference Locality in the WWW
Characterizing Reference Locality in the WWW
Weighted distributed hash tables
Proceedings of the seventeenth annual ACM symposium on Parallelism in algorithms and architectures
A comparison of file system workloads
ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference
Embedded inodes and explicit grouping: exploiting disk bandwidth for small files
ATEC '97 Proceedings of the annual conference on USENIX Annual Technical Conference
Dynamic and Redundant Data Placement
ICDCS '07 Proceedings of the 27th International Conference on Distributed Computing Systems
hFS: a hybrid file system prototype for improving small file and metadata performance
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
A five-year study of file-system metadata
ACM Transactions on Storage (TOS)
HBA: Distributed Metadata Management for Large Cluster-Based Storage Systems
IEEE Transactions on Parallel and Distributed Systems
RADOS: a scalable, reliable storage service for petabyte-scale storage clusters
PDSW '07 Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07
Scalable and Adaptive Metadata Management in Ultra Large-Scale File Systems
ICDCS '08 Proceedings of the 2008 The 28th International Conference on Distributed Computing Systems
Generating realistic impressions for file-system benchmarking
ACM Transactions on Storage (TOS)
MHS: A distributed metadata management strategy
Journal of Systems and Software
Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis
hashFS: Applying Hashing to Optimize File Systems for Small File Reads
SNAPI '10 Proceedings of the 2010 International Workshop on Storage Network Architecture and Parallel I/Os
Hierarchical file systems are dead
HotOS'09 Proceedings of the 12th conference on Hot topics in operating systems
Finding a needle in Haystack: facebook's photo storage
OSDI'10 Proceedings of the 9th USENIX conference on Operating systems design and implementation
A study of practical deduplication
FAST'11 Proceedings of the 9th USENIX conference on File and stroage technologies
| Hi-index | 0.00 |
New challenges to file systems' metadata performance are imposed by the continuously growing number of files existing in file systems. The total amount of metadata can become too big to be cached, potentially leading to multiple storage device accesses for a single metadata lookup operation. This paper takes a look at the limitations of traditional file system designs and discusses an alternative metadata handling approach, using hash-based concepts already established for metadata and data placement in distributed storage systems. Furthermore, a POSIX compliant prototype implementation based on these concepts is introduced and benchmarked. A variety of file system metadata and data operations as well as the influence of different storage technologies are taken into account and performance is compared with traditional file systems.