A super-peer model for multiple job submission on a grid

  • Authors:
  • Pasquale Cozza;Carlo Mastroianni;Domenico Talia;Ian Taylor

  • Affiliations:
  • DEIS University of Calabria, Rende, CS, Italy;ICAR-CNR, Rende, CS, Italy;DEIS University of Calabria, Rende, CS, Italy;Computer School, Cardiff University, UK

  • Venue:
  • Euro-Par'06 Proceedings of the CoreGRID 2006, UNICORE Summit 2006, Petascale Computational Biology and Bioinformatics conference on Parallel processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Submission of multiple jobs in a distributed and heterogeneous environment is required by applications that rely on the "public-resource computing" paradigm. We present here a scientific scenario for the analysis of astronomical data, where some nodes are responsible for maintaining and advertising job description files and other so called worker nodes, are dispersed over the Grid to execute the jobs. Job assignment is performed through a mechanism that matches adverts, containing job descriptions, with job queries that are sent by available workers across the Grid exploiting an underlying super-peer topology. With an analogous mechanism, a worker locates the input data file needed to run a job and downloads it from a data center node. This paper presents a super-peer protocol for the submission of a very large number of jobs on a Grid environment. The super-peer architecture enables the replication of data files on multiple data centers, which helps reduce the processing load and speed up the application. A simulation analysis has been performed to evaluate the impact of application and network parameters on performance results.