Portable checkpointing and communication for BSP applications on dynamic heterogeneous Grid environments

  • Authors:
  • Raphael Y. De Camargo;Fabio Kon;Alfredo Goldman

  • Affiliations:
  • Universidade de Sao Paulo, Brazil;Universidade de Sao Paulo, Brazil;Universidade de Sao Paulo, Brazil

  • Venue:
  • SBAC-PAD '05 Proceedings of the 17th International Symposium on Computer Architecture on High Performance Computing
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Executing long-running parallel applications in Opportunistic Grid environments composed of heterogeneous, shared user workstations, is a daunting task. Machines may fail, become unaccessible, or may switch from idle to busy unexpectedly, compromising the execution of applications. A mechanism for fault-tolerance that supports these heterogeneous architectures is an important requirement for such a system. In this paper, we describe the support for fault-tolerant execution of BSP parallel applications on heterogeneous, shared workstations. A precompiler instruments application source code to save state periodically into checkpoint files. In case of failure, it is possible to recover the stored state from these files. Generated checkpoints are portable and can be recovered in a machine of different architecture, with data representation conversions being performed at recovery time. The precompiler also modifies BSP parallel applications to allow execution on a Grid composed of machines with different architectures. We implemented a monitoring and recovering infrastructure in the InteGrade Grid middleware. Experimental results evaluate the overhead incurred and the viability of using this approach in a Grid environment.