ACM Transactions on Computer Systems (TOCS)
Scale and performance in a distributed file system
ACM Transactions on Computer Systems (TOCS)
Measurements of a distributed file system
SOSP '91 Proceedings of the thirteenth ACM symposium on Operating systems principles
The design and implementation of a log-structured file system
ACM Transactions on Computer Systems (TOCS)
A real-time garbage collector based on the lifetimes of objects
Communications of the ACM
Transaction Support in a Log-Structured File System
Proceedings of the Ninth International Conference on Data Engineering
Heuristic cleaning algorithms in log-structured file systems
TCON'95 Proceedings of the USENIX 1995 Technical Conference Proceedings
The Zebra striped network file system
ACM Transactions on Computer Systems (TOCS)
The HP AutoRAID hierarchical storage system
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
Serverless network file systems
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
The measured performance of personal computer operating systems
SOSP '95 Proceedings of the fifteenth ACM symposium on Operating systems principles
The measured performance of personal computer operating systems
ACM Transactions on Computer Systems (TOCS) - Special issue on operating system principles
Serverless network file systems
ACM Transactions on Computer Systems (TOCS) - Special issue on operating system principles
The HP AutoRAID hierarchical storage system
ACM Transactions on Computer Systems (TOCS) - Special issue on operating system principles
ACM Transactions on Computer Systems (TOCS)
File system aging—increasing the relevance of file system benchmarks
SIGMETRICS '97 Proceedings of the 1997 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Improving the performance of log-structured file systems with adaptive methods
Proceedings of the sixteenth ACM symposium on Operating systems principles
Virtual log based file systems for a programmable disk
OSDI '99 Proceedings of the third symposium on Operating systems design and implementation
Deciding when to forget in the Elephant file system
Proceedings of the seventeenth ACM symposium on Operating systems principles
Implications of proxy caching for provisioning networks and servers
Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
External memory algorithms and data structures: dealing with massive data
ACM Computing Surveys (CSUR)
DualFS: a new journaling file system without meta-data duplication
ICS '02 Proceedings of the 16th international conference on Supercomputing
RAPID-Cache-A Reliable and Inexpensive Write Cache for High Performance Storage Systems
IEEE Transactions on Parallel and Distributed Systems
UCFS-A Novel User-Space, High Performance, Customized File System for Web Proxy Servers
IEEE Transactions on Computers
Design Evolution of the EROS Single-Level Store
ATEC '02 Proceedings of the General Track of the annual conference on USENIX Annual Technical Conference
Bridging the Information Gap in Storage Protocol Stacks
ATEC '02 Proceedings of the General Track of the annual conference on USENIX Annual Technical Conference
Unifying File System Protection
Proceedings of the General Track: 2002 USENIX Annual Technical Conference
Handbook of massive data sets
SRDS '99 Proceedings of the 18th IEEE Symposium on Reliable Distributed Systems
A Novel Reordering Write Buffer to Improve Write Performance of Log-Structured File Systems
IEEE Transactions on Computers
The Brave Little Toaster Meets Usenet
LISA '96 Proceedings of the 10th USENIX conference on System administration
WOLF--A Novel Reordering Write Buffer to Boost the Performance of Log-Structured File System
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
PersonalRAID: Mobile Storage for Distributed and Disconnected Computers
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Configuring and Scheduling an Eager-Writing Disk Array for a Transaction Processing Workload
FAST '02 Proceedings of the 1st USENIX Conference on File and Storage Technologies
Metadata Efficiency in Versioning File Systems
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
HyLog: A High Performance Approach to Managing Disk Layout
FAST '04 Proceedings of the 3rd USENIX Conference on File and Storage Technologies
Meta-data snapshotting: a simple mechanism for file system consistency
SNAPI '03 Proceedings of the international workshop on Storage network architecture and parallel I/Os
The Design of New Journaling File Systems: The DualFS Case
IEEE Transactions on Computers
Towards higher disk head utilization: extracting free bandwidth from busy disk drives
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Self-securing storage: protecting data in compromised system
OSDI'00 Proceedings of the 4th conference on Symposium on Operating System Design & Implementation - Volume 4
Journaling versus soft updates: asynchronous meta-data protection in file systems
ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference
LinLogFS: a log-structured filesystem for Linux
ATEC '00 Proceedings of the annual conference on USENIX Annual Technical Conference
Fast consistency checking for the Solaris file system
ATEC '98 Proceedings of the annual conference on USENIX Annual Technical Conference
Scalability in the XFS file system
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
A comparison of FFS disk allocation policies
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Cut-and-paste file-systems: integrating simulators and file-systems
ATEC '96 Proceedings of the 1996 annual conference on USENIX Annual Technical Conference
Embedded inodes and explicit grouping: exploiting disk bandwidth for small files
ATEC '97 Proceedings of the annual conference on USENIX Annual Technical Conference
Hyperion: high volume stream archival for retrospective querying
ATC'07 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference
Towards tamper-evident storage on patterned media
FAST'08 Proceedings of the 6th USENIX Conference on File and Storage Technologies
Algorithms and data structures for external memory
Foundations and Trends® in Theoretical Computer Science
EAR: An Energy-Aware Block Reallocation Framework for Energy Efficiency
ICCS '07 Proceedings of the 7th international conference on Computational Science, Part IV: ICCS 2007
The case of the fake Picasso: preventing history forgery with secure provenance
FAST '09 Proccedings of the 7th conference on File and storage technologies
Measuring Fragmentation of Two-Dimensional Resources Applied to Advance Reservation Grid Scheduling
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Preventing history forgery with secure provenance
ACM Transactions on Storage (TOS)
Adding aggressive error correction to a high-performance compressing flash file system
EMSOFT '09 Proceedings of the seventh ACM international conference on Embedded software
Optimizations of LFS with slack space recycling and lazy indirect block update
Proceedings of the 3rd Annual Haifa Experimental Systems Conference
Avoiding file system micromanagement with range writes
OSDI'08 Proceedings of the 8th USENIX conference on Operating systems design and implementation
WOLF: a novel reordering write buffer to boost the performance of log-structured file systems
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
PersonalRAID: mobile storage for distributed and disconnected computers
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Track-aligned extents: matching access patterns to disk drive characteristics
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Configuring and scheduling an eager-writing disk array for a transaction processing workload
FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
Metadata efficiency in versioning file systems
FAST'03 Proceedings of the 2nd USENIX conference on File and storage technologies
HyLog: a high performance approach to managing disk layout
FAST'04 Proceedings of the 3rd USENIX conference on File and storage technologies
Fast crash recovery in RAMCloud
SOSP '11 Proceedings of the Twenty-Third ACM Symposium on Operating Systems Principles
Benchmarking and testing OSD for correctness and compliance
HVC'05 Proceedings of the First Haifa international conference on Hardware and Software Verification and Testing
SFS: random write considered harmful in solid state drives
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
bLSM: a general purpose log structured merge tree
SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
CORFU: a shared log design for flash clusters
NSDI'12 Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation
Gecko: a contention-oblivious design for cloud storage
HotStorage'12 Proceedings of the 4th USENIX conference on Hot Topics in Storage and File Systems
Improving Bandwidth Efficiency for Consistent Multistream Storage
ACM Transactions on Storage (TOS)
Beyond block I/O: implementing a distributed shared log in hardware
Proceedings of the 6th International Systems and Storage Conference
CORFU: A distributed shared log
ACM Transactions on Computer Systems (TOCS)
Gecko: contention-oblivious disk arrays for cloud storage
FAST'13 Proceedings of the 11th USENIX conference on File and Storage Technologies
Log-structured memory for DRAM-based storage
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
FAST'14 Proceedings of the 12th USENIX conference on File and Storage Technologies
Blizzard: fast, cloud-scale block storage for cloud-oblivious applications
NSDI'14 Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation
Hi-index | 0.01 |
The Log-structured File System (LFS), introduced in 1991 [8], has received much attention for its potential order-of-magnitude improvement in file system performance. Early research results [9] showed that small file performance could scale with processor speed and that cleaning costs could be kept low, allowing LFS to write at an effective bandwidth of 62 to 83% of the maximum. Later work showed that the presence of synchronous disk operations could degrade performance by as much as 62% and that cleaning overhead could become prohibitive in transaction processing workloads, reducing performance by as much as 40% [10]. The same work showed that the addition of clustered reads and writes in the Berkeley Fast File System [6] (FFS) made it competitive with LFS in large-file handling and software development environments as approximated by the Andrew benchmark [4]. These seemingly inconsistent results have caused confusion in the file system research community. This paper presents a detailed performance comparison of the 4.4BSD Log-structured File System and the 4.4BSD Fast File System. Ignoring cleaner overhead, our results show that the order-of-magnitude improvement in performance claimed for LFS applies only to meta-data intensive activities, specifically the creation of files one-kilobyte or less and deletion of files 64 kilobytes or less. For small files, both systems provide comparable read performance, but LFS offers superior performance on writes. For large files (one megabyte and larger), the performance of the two file systems is comparable. When FFS is tuned for writing, its large-file write performance is approximately 15% better than LFS, but its read performance is 25% worse. When FFS is optimized for reading, its large-file read and write performance is comparable to LFS. Both LFS and FFS can suffer performance degradation, due to cleaning and disk fragmentation respectively. We find that active FFS file systems function at approximately 85-95% of their maximum performance after two to three years. We examine LFS cleaner performance in a transaction processing environment and find that cleaner overhead reduces LFS performance by more than 33% when the disk is 50% full.