The MicroGrid: Using Online Simulation to Predict Application Performance in Diverse Grid Network Environments

  • Authors:
  • Affiliations:
  • Venue:
  • CLADE '04 Proceedings of the 2nd International Workshop on Challenges of Large Applications in Distributed Environments
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Improvements in networking and middleware technologyare enabling large-scale grids that aggregateresources over wide-area networks to support applicationsat unprecedented levels of scale and performance.Unfortunately, existing middleware and tools provide littleinformation to users as to the suitability of a given gridtopology for a specific grid application. Instead, users generallyuse ad-hoc performance models to evaluate mappingsof their applications to resource and network topologies.Grid application behavior alone is complex, andadding resource and network behavior makes the situationeven worse. As a result, users typically employ nearlyblind experimentation to find good deployments of their applicationsin each new grid environment. Only through actualdeployment and execution can a user discovers ifthe mapping was a good one. Further, even after findinga good configuration, there is no basis to determineif a much better configuration has been missed. This approachslows effective grid application development anddeployment.We present a richer methodology for evaluating gridsoftware and diverse grid environments based on the MicroGridgrid online simulator. With the MicroGrid, users,grid researchers, or grid operators can define and simulatearbitrary collections of resources and networks. This allowsstudy of an existing grid testbed under controlled conditionsor even to study the efficacy of higher performance environmentsthan are available today. Further, the MicroGridsupports direct execution of grid applications unchanged.These application can be written with MPI, C, C++, Perl,and/or Python and use the Globus middleware. This enablesdetailed and accurate study of application behavior. Thispaper presents: (1) the first validation of the MicroGrid forstudying whole-program performance of MPI Grid applicationsand (2) a demonstration of the MicroGrid as a toolfor predicting the performance of applications on a rangeof grid resources and novel network topologies.