WOLF: a novel reordering write buffer to boost the performance of log-structured file systems

  • Authors:
  • Jun Wang;Yiming Hu

  • Affiliations:
  • Department of Electrical & Computer Engineering and Computer Science, University of Cincinnati, Cincinnati, OH;Department of Electrical & Computer Engineering and Computer Science, University of Cincinnati, Cincinnati, OH

  • Venue:
  • FAST'02 Proceedings of the 1st USENIX conference on File and storage technologies
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents the design, simulation and performance evaluation of a novel reordering write buffer for Log-structured File Systems (LFS). While LFS provides good write performance for small files, its biggest problem is the high overhead from cleaning. Previous research concentrated on improving the cleaner's efficiency after files are written to the disk. We propose a new method that reduces the amount of work the cleaner has to do before the data reaches the disk. Our design sorts active and inactive data in memory into different segment buffers and then writes them to different disk segments. This approach forces data on the disk into a bimodal distribution. Most data in active segments are quickly invalidated, while inactive segments are mostly intact. Simulation results based on both real-world and synthetic traces show that such a reordering write buffer dramatically reduces the cleaning overhead, slashing the system's overall write cost by up to 53%.