Disk Scrubbing in Large Archival Storage Systems

  • Authors:

  • Thomas J. E. Schwarz;Qin Xin;Ethan L. Miller;Darrell D. E. Long;Andy Hospodor;Spencer Ng

  • Affiliations:

  • Santa Clara University and University of California at Santa Cruz;University of California at Santa Cruz and Hitachi Global Storage Technologies;University of California at Santa Cruz;University of California at Santa Cruz;Santa Clara University;Hitachi Global Storage Technologies

  • Venue:
  • MASCOTS '04 Proceedings of the The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Large archival storage systems experience long periods of idleness broken up by rare data accesses. In such systems, disks may remain powered off for long periods of time. These systems can lose data for a variety of reasons, including failures at both the device level and the block level. To deal with these failures, we must detect them early enough to be able to use the redundancy built into the storage system. We propose a process called "disk scrubbing" in a system in which drives are periodically accessed to detect drive failure. By scrubbing all of the data stored on all of the disks, we can detect block failures and compensate for them by rebuilding the affected blocks. Our research shows how the scheduling of disk scrubbing affects overall system reliability, and that "opportunistic" scrubbing, in which the system scrubs disks only when they are powered on for other reasons, performs very well without the need to power on disks solely to check them.