Symmetric active/active metadata service for high availability parallel file systems

  • Authors:
  • Xubin He;Li Ou;Christian Engelmann;Xin Chen;Stephen L. Scott

  • Affiliations:
  • Department of Electrical and Computer Engineering, Tennessee Technological University, United States;Scalable Systems Group, Dell Inc., United States;Computer Science and Mathematics Division, Oak Ridge National Laboratory, United States;Department of Electrical and Computer Engineering, Tennessee Technological University, United States;Computer Science and Mathematics Division, Oak Ridge National Laboratory, United States

  • Venue:
  • Journal of Parallel and Distributed Computing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

High availability data storage systems are critical for many applications as research and business become more data driven. Since metadata management is essential to system availability, multiple metadata services are used to improve the availability of distributed storage systems. Past research has focused on the active/standby model, where each active service has at least one redundant idle backup. However, interruption of service and even some loss of service state may occur during a fail-over depending on the replication technique used. In addition, the replication overhead for multiple metadata services can be very high. The research in this paper targets the symmetric active/active replication model, which uses multiple redundant service nodes running in virtual synchrony. In this model, service node failures do not cause a fail-over to a backup and there is no disruption of service or loss of service state. A fast delivery protocol is further discussed to reduce the latency of the total order broadcast needed. The prototype implementation shows that metadata service high availability can be achieved with an acceptable performance trade-off using the symmetric active/active metadata service solution.