MPICH-V2: a Fault Tolerant MPI for Volatile Nodes based on Pessimistic Sender Based Message Logging

Authors:
Auré/lien Bouteiller;Franck Cappello;Thomas Herault;Gé/raud Krawezik;Pierre Lemarinier;Fré/dé/ric Magniette
Affiliations:
LRI, Université/ de Paris Sud, Orsay, France;LRI, Université/ de Paris Sud, Orsay, France/ INRIA Futurs, Saclay, France;LRI, Université/ de Paris Sud, Orsay, France;LRI, Université/ de Paris Sud, Orsay, France;LRI, Université/ de Paris Sud, Orsay, France;LRI, Université/ de Paris Sud, Orsay, France
Venue:
Proceedings of the 2003 ACM/IEEE conference on Supercomputing
Year:
2003

Citing 16
Cited 51

Optimistic recovery in distributed systems

ACM Transactions on Computer Systems (TOCS)
Manetho: Transparent Roll Back-Recovery with Low Overhead, Limited Rollback, and Fast Output Commit

IEEE Transactions on Computers - Special issue on fault-tolerant computing
Introduction to distributed algorithms

Introduction to distributed algorithms
Impossibility of distributed consensus with one faulty process

Journal of the ACM (JACM)
Distributed snapshots: determining global states of distributed systems

ACM Transactions on Computer Systems (TOCS)
The network architecture of the connection machine CM-5

Journal of Parallel and Distributed Computing
A high-performance, portable implementation of the MPI message passing interface standard

Parallel Computing
CLIP: a checkpointing tool for message-passing parallel programs

SC '97 Proceedings of the 1997 ACM/IEEE conference on Supercomputing
HARNESS and fault tolerant MPI

Parallel Computing - Clusters and computational grids for scientific computing
MPI: The Complete Reference

MPI: The Complete Reference
CoCheck: Checkpointing and Process Migration for MPI

IPPS '96 Proceedings of the 10th International Parallel Processing Symposium
MPICH-V: toward a scalable fault tolerant MPI for volatile nodes

Proceedings of the 2002 ACM/IEEE conference on Supercomputing
MPI/FTTM: Architecture and Taxonomies for Fault-Tolerant, Message-Passing Middleware for Performance-Portable Parallel Computing

CCGRID '01 Proceedings of the 1st International Symposium on Cluster Computing and the Grid
Egida: An Extensible Toolkit For Low-Overhead Fault-Tolerance

FTCS '99 Proceedings of the Twenty-Ninth Annual International Symposium on Fault-Tolerant Computing
Starfish: Fault-Tolerant Dynamic MPI Programs on Clusters of Workstations

HPDC '99 Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing
Message logging: pessimistic, optimistic, and causal

ICDCS '95 Proceedings of the 15th International Conference on Distributed Computing Systems

Implementation and Evaluation of a Scalable Application-Level Checkpoint-Recovery Scheme for MPI Programs

Proceedings of the 2004 ACM/IEEE conference on Supercomputing
Impact of Event Logger on Causal Message Logging Protocols for Fault Tolerant MPI

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Combining FT-MPI with H2O: Fault-Tolerant MPI Across Administrative Boundaries

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 1 - Volume 02
Event Logging: Portable and Efficient Checkpointing in Heterogeneous Environments with Non-FIFO Communication Platforms

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 1 - Volume 02
Fault-Tolerant Parallel Applications with Dynamic Parallel Schedules

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 16 - Volume 17
Failure Resilient Heterogeneous Parallel Computing Across Multidomain Clusters

International Journal of High Performance Computing Applications
Computing on large-scale distributed systems: Xtrem Web architecture, programming models, security, tests and convergence with grid

Future Generation Computer Systems - Special issue: P2P computing and interaction with grids
A channel memory based fault tolerance for MPI applications

Future Generation Computer Systems - Special issue: Parallel computing technologies
Design and Implementation of Multiple Fault-Tolerant MPI over Myrinet (M^3)

SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
HPC-Colony: services and interfaces for very large systems

ACM SIGOPS Operating Systems Review
A robust framework for real-time distributed processing of satellite data

Journal of Parallel and Distributed Computing
Worldwide computing: Adaptive middleware and programming technology for dynamic Grid environments

Scientific Programming - Dynamic Grids and Worldwide Computing
The Internet Operating System: Middleware for Adaptive Distributed Computing

International Journal of High Performance Computing Applications
A serialization based approach for strong mobility of shared object

Proceedings of the 5th international symposium on Principles and practice of programming in Java
Coordinated checkpoint versus message log for fault tolerant MPI

International Journal of High Performance Computing and Networking
CprFS: a user-level file system to support consistent file states for checkpoint and restart

Proceedings of the 22nd annual international conference on Supercomputing
2-step algorithm for enhancing effectiveness of sender-based message logging

SpringSim '07 Proceedings of the 2007 spring simulation multiconference - Volume 2
Novel log management for sender-based message logging

ICAI'08 Proceedings of the 9th WSEAS International Conference on International Conference on Automation and Information
Experimental Assessment of the Practicality of a Fault-Tolerant System

SOFSEM '07 Proceedings of the 33rd conference on Current Trends in Theory and Practice of Computer Science
Lightweight log management algorithm for removing logged messages of sender processes with little overhead

WSEAS Transactions on Computers
Challenges and Issues of the Integration of RADIC into Open MPI

Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
VolpexMPI: An MPI Library for Execution of Parallel Applications on Volatile Nodes

Proceedings of the 16th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
Active Optimistic Message Logging for Reliable Execution of MPI Applications

Euro-Par '09 Proceedings of the 15th International Euro-Par Conference on Parallel Processing
A Channel Memory based fault tolerance for MPI applications

Future Generation Computer Systems - Special issue: Parallel computing technologies
Fault-management in P2P-MPI

International Journal of Parallel Programming
JaceV: a programming and execution environment for asynchronous iterative computations on volatile nodes

VECPAR'06 Proceedings of the 7th international conference on High performance computing for computational science
A High-Level Interpreted MPI Library for Parallel Computing in Volunteer Environments

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Reliable parallel programming model for distributed computing environments

Euro-Par'09 Proceedings of the 2009 international conference on Parallel processing
Improving message logging protocols scalability through distributed event logging

EuroPar'10 Proceedings of the 16th international Euro-Par conference on Parallel processing: Part I
Communication target selection for replicated MPI processes

EuroMPI'10 Proceedings of the 17th European MPI users' group meeting conference on Recent advances in the message passing interface
Transparent redundant computing with MPI

EuroMPI'10 Proceedings of the 17th European MPI users' group meeting conference on Recent advances in the message passing interface
Coordinated checkpoint from message payload in pessimistic sender-based message logging

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Mesos: a platform for fine-grained resource sharing in the data center

Proceedings of the 8th USENIX conference on Networked systems design and implementation
A Robust and Efficient Message Passing Library for Volunteer Computing Environments

Journal of Grid Computing
Proactive fault tolerance in MPI applications via task migration

HiPC'06 Proceedings of the 13th international conference on High Performance Computing
FT-MPI, fault-tolerant metacomputing and generic name services: a case study

EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface
Extended mpijava for distributed checkpointing and recovery

EuroPVM/MPI'06 Proceedings of the 13th European PVM/MPI User's Group conference on Recent advances in parallel virtual machine and message passing interface
Checkpointing and communication pattern-neutral algorithm for removing messages logged by senders

HPCC'06 Proceedings of the Second international conference on High Performance Computing and Communications
SHIELD: a fault-tolerant MPI for an infiniband cluster

HPCC'06 Proceedings of the Second international conference on High Performance Computing and Communications
Self-refined fault tolerance in HPC using dynamic dependent process groups

IWDC'05 Proceedings of the 7th international conference on Distributed Computing
Applicability of generic naming services and fault-tolerant metacomputing with FT-MPI

PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
A peer-to-peer framework for robust execution of message passing parallel programs on grids

PVM/MPI'05 Proceedings of the 12th European PVM/MPI users' group conference on Recent Advances in Parallel Virtual Machine and Message Passing Interface
A checkpoint/recovery model for heterogeneous dataflow computations using work-stealing

Euro-Par'05 Proceedings of the 11th international Euro-Par conference on Parallel Processing
A communication framework for fault-tolerant parallel execution

LCPC'09 Proceedings of the 22nd international conference on Languages and Compilers for Parallel Computing
An efficient algorithm for removing useless logged messages in SBML protocols

ICDCIT'05 Proceedings of the Second international conference on Distributed Computing and Internet Technology
HOPE: A Hybrid Optimistic checkpointing and selective Pessimistic mEssage logging protocol for large scale distributed systems

Future Generation Computer Systems
Independent checkpointing in a heterogeneous grid environment

Future Generation Computer Systems
Programming model support for dependable, elastic cloud applications

HotDep'12 Proceedings of the Eighth USENIX conference on Hot Topics in System Dependability
Alleviating scalability issues of checkpointing protocols

SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
The viability of using compression to decrease message log sizes

Euro-Par'12 Proceedings of the 18th international conference on Parallel processing workshops
Compiler-Assisted Checkpointing of Parallel Codes: The Cetus and LLVM Experience

International Journal of Parallel Programming

Quantified Score

Hi-index	0.00

Visualization

Abstract

Execution of MPI applications on clusters and Grid deployments suffering from node and network failures motivates the use of fault tolerant MPI implementations. We present MPICH-V2 (the second protocol of MPICH-V project), an automatic fault tolerant MPI implementation using an innovative protocol that removes the most limiting factor of the pessimistic message logging approach: reliable logging of in transit messages. MPICH-V2 relies on uncoordinated checkpointing, sender based message logging and remote reliable logging of message logical clocks. This paper presents the architecture of MPICH-V2, its theoretical foundation and the performance of the implementation. We compare MPICH-V2 to MPICH-V1 and MPICH-P4 evaluating a) its point-to-point performance, b) the performance for the NAS benchmarks, c) the application performance when many faults occur during the execution. Experimental results demonstrate that MPICH-V2 provides performance close to MPICH-P4 for applications using large messages while reducing dramatically the number of reliable nodes compared to MPICH-V1.