SHIELD: a fault-tolerant MPI for an infiniband cluster

Authors:
Hyuck Han;Hyungsoo Jung;Jai Wug Kim;Jongpil Lee;Youngjin Yu;Shin Gyu Kim;Heon Y. Yeom
Affiliations:
School of Computer Science and Engineering, Seoul National University, Seoul, South Korea;School of Computer Science and Engineering, Seoul National University, Seoul, South Korea;School of Computer Science and Engineering, Seoul National University, Seoul, South Korea;School of Computer Science and Engineering, Seoul National University, Seoul, South Korea;School of Computer Science and Engineering, Seoul National University, Seoul, South Korea;School of Computer Science and Engineering, Seoul National University, Seoul, South Korea;School of Computer Science and Engineering, Seoul National University, Seoul, South Korea
Venue:
HPCC'06 Proceedings of the Second international conference on High Performance Computing and Communications
Year:
2006

Citing 8
Cited 0

CoCheck: Checkpointing and Process Migration for MPI

IPPS '96 Proceedings of the 10th International Parallel Processing Symposium
FT-MPI: Fault Tolerant MPI, Supporting Dynamic Applications in a Dynamic World

Proceedings of the 7th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
MPICH-V: toward a scalable fault tolerant MPI for volatile nodes

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
High performance RDMA-based MPI implementation over InfiniBand

ICS '03 Proceedings of the 17th annual international conference on Supercomputing
MPICH-V2: a Fault Tolerant MPI for Volatile Nodes based on Pessimistic Sender Based Message Logging

Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Design and Implementation of Multiple Fault-Tolerant MPI over Myrinet (M^3)

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Elections in a Distributed Computing System

IEEE Transactions on Computers
Performance evaluation of consistent recovery protocols using MPICH-GF

EDCC'05 Proceedings of the 5th European conference on Dependable Computing

Quantified Score

Hi-index	0.01

Visualization

Abstract

Today's high performance cluster computing technologies demand extreme robustness against unexpected failures to finish aggressively parallelized work in a given time constraint. Although there has been a steady effort in developing hardware and software tools to increase fault-resilience of cluster environments, a successful solution has yet to be delivered to commercial vendors. This paper presents SHIELD, a practical and easily-deployable fault-tolerant MPI and management system of MPI for an Infiniband cluster. SHIELD provides a novel framework that can be easily used in real cluster systems, and it has different design perspectives than those proposed by other fault-tolerant MPI. We show that SHIELD provides robust fault-resilience to fault-vulnerable cluster systems and that the design features of SHIELD are useful wherever fault-resilience is regarded as the matter of utmost importance.