Atomic writes for data integrity and consistency in shared storage devices for clusters

  • Authors:
  • Michael Okun;Amnon Barak

  • Affiliations:
  • School of Computer Science, The Hebrew University of Jerusalem 91904, Israel;School of Computer Science, The Hebrew University of Jerusalem 91904, Israel

  • Venue:
  • Future Generation Computer Systems - Special issue: Advanced services for clusters and internet computing
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

With the recent trend to use storage area networks in distributed and cluster systems there is a need to improve the integrity and consistency guarantees of stored data in the presence of node or network failures. Currently, the main method for preserving data integrity and consistency is by logging techniques, e.g. journaling. This paper presents a new general method for preserving data consistency by Atomic multi-block Writes. The Atomic Writes method guarantees that either all the blocks in a write operation are written or no blocks are written at all. Its main advantage is that it does not require a recovery phase after a failure. The Atomic Writes method should be implemented in both the operating system and the storage system levels. It is easy to use and to implement. We present the method, its implementation and an example of its use for handling meta-data consistency in an existing file system that supports shared storage.