FastMap: A Distributed Scheme for Mapping Large Scale Applications onto Computational Grids

  • Authors:
  • Affiliations:
  • Venue:
  • CLADE '04 Proceedings of the 2nd International Workshop on Challenges of Large Applications in Distributed Environments
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Many large and complex computational applications canbe modeled as irregular graphs and are typically characterizedby a large number of vertices and edges. This paper proposesa new and fast mapping heuristic, called FastMap, tomap this class of applications onto heterogeneous metacomputingplatforms such as computational grids. While previousapproaches have delved into graph partitioning of the application,we attempt to solve this problem from the clusteringperspective. We exploit a hierarchical resource managementinfrastructure on the grid to distribute the overhead of mappingamong a tree of schedulers and develop a scheme thatproves to be almost linear in its scalability. Furthermore, weoptimize on the result of the mapping with the help of a geneticalgorithm at each scheduler node. Our experiments include a50,000-node application graph from NASA and several othersynthetically-generated graphs with as many as 100,000 vertices.Comparisons with another heterogeneous partitioner,MiniMax, show an improvement factor of over 100 on themapping time, yet with superior quality mapping.