Beating the I/O bottleneck: a case for log-structured file systems
ACM SIGOPS Operating Systems Review
The design and implementation of a log-structured file system
ACM Transactions on Computer Systems (TOCS)
DCD—disk caching disk: a new approach for boosting I/O performance
ISCA '96 Proceedings of the 23rd annual international symposium on Computer architecture
Improving the performance of log-structured file systems with adaptive methods
Proceedings of the sixteenth ACM symposium on Operating systems principles
The art of computer programming, volume 3: (2nd ed.) sorting and searching
The art of computer programming, volume 3: (2nd ed.) sorting and searching
Virtual log based file systems for a programmable disk
OSDI '99 Proceedings of the third symposium on Operating systems design and implementation
Soft updates: a solution to the metadata update problem in file systems
ACM Transactions on Computer Systems (TOCS)
WOLF - A Novel Reordering Write Buffer to Boost the Performance of Log-Structured File Systems
FAST '02 Proceedings of the Conference on File and Storage Technologies
Track-Aligned Extents: Matching Access Patterns to Disk Drive Characteristics
FAST '02 Proceedings of the Conference on File and Storage Technologies
Freeblock Scheduling Outside of Disk Firmware
FAST '02 Proceedings of the Conference on File and Storage Technologies
A performance comparison of RAID-5 and log-structured arrays
HPDC '95 Proceedings of the 4th IEEE International Symposium on High Performance Distributed Computing
Rules of Thumb in Data Engineering
ICDE '00 Proceedings of the 16th International Conference on Data Engineering
PROFS-Performance-Oriented Data Reorganization for Log-Structured File System on Multi-Zone Disks
MASCOTS '01 Proceedings of the Ninth International Symposium in Modeling, Analysis and Simulation of Computer and Telecommunication Systems
Characteristics of production database workloads and the TPC benchmarks
IBM Systems Journal - End-to-end security
yFS: A Journaling File System Design for Handling Large Data Sets with Reduced Seeking
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
Passive NFS Tracing of Email and Research Workloads
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
More Than an Interface---SCSI vs. ATA
FAST '03 Proceedings of the 2nd USENIX Conference on File and Storage Technologies
File system logging versus clustering: a performance comparison
TCON'95 Proceedings of the USENIX 1995 Technical Conference Proceedings
Heuristic cleaning algorithms in log-structured file systems
TCON'95 Proceedings of the USENIX 1995 Technical Conference Proceedings
Improving the performance of log-structured file systems with adaptive block rearrangement
Proceedings of the 2007 ACM symposium on Applied computing
hFS: a hybrid file system prototype for improving small file and metadata performance
Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007
Uniformity improving page allocation for flash memory file systems
EMSOFT '07 Proceedings of the 7th ACM & IEEE international conference on Embedded software
Hyperion: high volume stream archival for retrospective querying
ATC'07 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference
Performance Characteristics of Flash Memory: Model and Implications
ICESS '07 Proceedings of the 3rd international conference on Embedded Software and Systems
Model and validation of block cleaning cost for flash memory
SAMOS'07 Proceedings of the 7th international conference on Embedded computer systems: architectures, modeling, and simulation
Lithium: virtual machine storage for the cloud
Proceedings of the 1st ACM symposium on Cloud computing
Optimizations of LFS with slack space recycling and lazy indirect block update
Proceedings of the 3rd Annual Haifa Experimental Systems Conference
Janus-FTL: finding the optimal point on the spectrum between page and block mapping schemes
EMSOFT '10 Proceedings of the tenth ACM international conference on Embedded software
An update-aware storage system for low-locality update-intensive workloads
ASPLOS XVII Proceedings of the seventeenth international conference on Architectural Support for Programming Languages and Operating Systems
SFS: random write considered harmful in solid state drives
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
FAST'12 Proceedings of the 10th USENIX conference on File and Storage Technologies
Hi-index | 0.00 |
Our objective is to improve disk I/O performance in multi-disk systems supporting multiple concurrent users, such as file servers, database servers, and email servers. In such systems, many disk reads are absorbed by large in-memory buffers, and so disk writes comprise a large portion of the disk I/O traffic. LFS (Log-structured File System) has the potential to achieve superior write performance by accumulating small writes into large blocks and writing them to new places, rather than overwriting on top of their old copies (called Overwrite). Although it is commonly believed that the high segment cleaning overhead of LFS makes it a poor choice for workloads with random updates, in this paper we find that because of the fast improvement of disk technologies, LFS significantly outperforms Overwrite in a wide range of system configurations and workloads (including the random update workload) under modern and future disks.LFS performs worse than Overwrite, however, when the disk space utilization is very high due to the high cleaning cost. In this paper, we propose a new approach, the Hybrid Log-structured (HyLog) disk layout, to overcome this problem. HyLog uses a log-structured approach for hot pages to achieve high write performance, and Overwrite for cold pages to reduce the cleaning cost. We compare the performance of HyLog to that of Overwrite, LFS and WOLF (the latest improvement on LFS) under various system configurations and workloads. Our results show that, in most cases, Hylog performs comparably to the best of the other three approaches.