Dynamic load balancing of black-box applications with a resource selection mechanism on heterogeneous resources of the grid

  • Authors:

  • Valeria V. Krzhizhanovskaya;Vladimir V. Korkhov

  • Affiliations:

  • University of Amsterdam, Faculty of Science, Section Computational Science and St. Petersburg State Polytechnic University, Russia;University of Amsterdam, Faculty of Science, Section Computational Science and St. Petersburg State Polytechnic University, Russia

  • Venue:
  • PaCT'07 Proceedings of the 9th international conference on Parallel Computing Technologies
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we address the critical issues of efficient resource management and high-performance parallel distributed computing on the Grid by introducing a new hierarchical approach that combines a user-level job scheduling with a dynamic load balancing technique that automatically adapts a blackbox distributed or parallel application to the heterogeneous resources. The algorithm developed dynamically selects the resources best suited for a particular task or parallel process of the executed application, and optimizes the load balance based on the dynamically measured resource parameters and estimated requirements of the application. We describe the proposed algorithm for automated load balancing, paying attention to the influence of resource heterogeneity metrics, demonstrate the speedup achieved with this technique for different types of applications and resources, and propose a way to extend the approach to a wider class of applications.