Dynamic workload balancing of parallel applications with user-level scheduling on the Grid

Authors:
Vladimir V. Korkhov;Jakub T. Moscicki;Valeria V. Krzhizhanovskaya
Affiliations:
Section Computational Science, University of Amsterdam, The Netherlands;CERN, Switzerland;Section Computational Science, University of Amsterdam, The Netherlands and St. Petersburg State Polytechnic University, Russia
Venue:
Future Generation Computer Systems
Year:
2009

Citing 17
Cited 8

A dynamic load balancing system for parallel cluster computing

Future Generation Computer Systems - Special issue: resource management in distributed systems
Load balancing by redundant decomposition and mapping

Future Generation Computer Systems - Special issue on HPCN96
On the complexity of task allocation

Complexity
Source Code Transformations Strategies to Load-Balance Grid Applications

GRID '02 Proceedings of the Third International Workshop on Grid Computing
Adaptive Runtime Partitioning of AMR Applications on Heterogeneous Clusters

CLUSTER '01 Proceedings of the 3rd IEEE International Conference on Cluster Computing
Master/Slave Computing on the Grid

HCW '00 Proceedings of the 9th Heterogeneous Computing Workshop
Grid resource management: state of the art and future trends

Grid resource management: state of the art and future trends
The Grid 2: Blueprint for a New Computing Infrastructure

The Grid 2: Blueprint for a New Computing Infrastructure
Grid-Based Simulation of Industrial Thin-Film Production

Simulation
Single System Image

International Journal of High Performance Computing Applications
Computational Engineering on the Grid: Crafting a Distributed Virtual Reactor

E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
Non-evolutionary algorithm for scheduling dependent tasks in distributed heterogeneous computing environments

Journal of Parallel and Distributed Computing
A Novel Economic-Based Scheduling Heuristic for Computational Grids

International Journal of High Performance Computing Applications
The Internet Operating System: Middleware for Adaptive Distributed Computing

International Journal of High Performance Computing Applications
A Grid-based Virtual Reactor: Parallel performance and adaptive load balancing

Journal of Parallel and Distributed Computing
Benchmarking and adaptive load balancing of the virtual reactor application on the russian-dutch grid

ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part I
Dynamic load balancing of black-box applications with a resource selection mechanism on heterogeneous resources of the grid

PaCT'07 Proceedings of the 9th international conference on Parallel Computing Technologies

A novel approach for distributed application scheduling based on prediction of communication events

Future Generation Computer Systems
Virtual Organization Clusters: Self-provisioned clouds on the grid

Future Generation Computer Systems
A game-theoretic method of fair resource allocation for cloud computing services

The Journal of Supercomputing
Grid Based Genome Wide Studies on Atrial Flutter

Journal of Grid Computing
Processing moldable tasks on the grid: Late job binding with lightweight user-level overlay

Future Generation Computer Systems
Towards autonomic management for Cloud services based upon volunteered resources

Concurrency and Computation: Practice & Experience
Workflow as a service: an approach to workflow farming

Proceedings of the 3rd international workshop on Emerging computational methods for the life sciences
Efficient extension of gLite VOs with BOINC based desktop grids

Future Generation Computer Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper suggests a hybrid resource management approach for efficient parallel distributed computing on the Grid. It operates on both application and system levels, combining user-level job scheduling with dynamic workload balancing algorithm that automatically adapts a parallel application to the heterogeneous resources, based on the actual resource parameters and estimated requirements of the application. The hybrid environment and the algorithm for automated load balancing are described, the influence of resource heterogeneity level is measured, and the speedup achieved with this technique is demonstrated for different types of applications and resources.