Self healing in System-S

  • Authors:
  • Gabriela Jacques-Silva;Jim Challenger;Lou Degenaro;James Giles;Rohit Wagle

  • Affiliations:
  • Center for Reliable and High-Performance Computing, University of Illinois at Urbana Champaign, Urbana, USA 61820;IBM T.J. Watson Research Center, IBM Research, Hawthorne, USA 10532;IBM T.J. Watson Research Center, IBM Research, Hawthorne, USA 10532;IBM T.J. Watson Research Center, IBM Research, Hawthorne, USA 10532;IBM T.J. Watson Research Center, IBM Research, Hawthorne, USA 10532

  • Venue:
  • Cluster Computing
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Faults in a cluster are inevitable. The larger the cluster, the more likely the occurrence of some failure in hardware, in software, or by human error. System-S software must detect and self-repair failures while carrying out its prime directive--enabling stream processing program fragments to be distributed and connected to form complex applications. Depending on the type of failure, System-S may be able to continue with little or no disruption to potentially tens of thousands of interdependent and heterogeneous program fragments running across thousands of nodes.We extend the work we previously presented on the self healing nature of the job manager component in System-S by presenting how it can handle failures of other system components, applications and network infrastructure. We also evaluate the recoverability of the job management orchestrator component of System-S, considering crash failures with and without error propagation.