A Grid-based Virtual Reactor: Parallel performance and adaptive load balancing

Authors:
Vladimir V. Korkhov;Valeria V. Krzhizhanovskaya;P. M. A. Sloot
Affiliations:
University of Amsterdam, Section Computational Science, Netherlands and St. Petersburg State Polytechnic University, Russia;University of Amsterdam, Section Computational Science, Netherlands and St. Petersburg State Polytechnic University, Russia;University of Amsterdam, Section Computational Science, Netherlands
Venue:
Journal of Parallel and Distributed Computing
Year:
2008

Citing 18
Cited 7

Solving problems on concurrent processors. Vol. 1: General techniques and regular problems

Solving problems on concurrent processors. Vol. 1: General techniques and regular problems
Load balancing by redundant decomposition and mapping

Future Generation Computer Systems - Special issue on HPCN96
The implementation of dynamite: an environment for migrating PVM tasks

ACM SIGOPS Operating Systems Review
The MOSIX Distributed Operating System: Load Balancing for UNIX

The MOSIX Distributed Operating System: Load Balancing for UNIX
Dynamic load balancing of SAMR applications on distributed systems

Proceedings of the 2001 ACM/IEEE conference on Supercomputing
Distributed Simulation of Silicon-Based Film Growth

PPAM '01 Proceedings of the th International Conference on Parallel Processing and Applied Mathematics-Revised Papers
Source Code Transformations Strategies to Load-Balance Grid Applications

GRID '02 Proceedings of the Third International Workshop on Grid Computing
Adaptive Computing on the Grid Using AppLeS

IEEE Transactions on Parallel and Distributed Systems
Adaptive Runtime Partitioning of AMR Applications on Heterogeneous Clusters

CLUSTER '01 Proceedings of the 3rd IEEE International Conference on Cluster Computing
Master/Slave Computing on the Grid

HCW '00 Proceedings of the 9th Heterogeneous Computing Workshop
A performance comparison of adaptive and static load balancing in heterogeneous distributed systems

SS '95 Proceedings of the 28th Annual Simulation Symposium
Grid Harvest Service: A System for Long-Term, Application-Level Task Scheduling

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
An adaptive load balancing algorithm for heterogeneous distributed systems with multiple task classes

ICDCS '96 Proceedings of the 16th International Conference on Distributed Computing Systems (ICDCS '96)
Resource-Aware Scientific Computation on a Heterogeneous Cluster

Computing in Science and Engineering
Grid-Based Simulation of Industrial Thin-Film Production

Simulation
Computational Engineering on the Grid: Crafting a Distributed Virtual Reactor

E-SCIENCE '06 Proceedings of the Second IEEE International Conference on e-Science and Grid Computing
Benchmarking and adaptive load balancing of the virtual reactor application on the russian-dutch grid

ICCS'06 Proceedings of the 6th international conference on Computational Science - Volume Part I
Dynamic load balancing of black-box applications with a resource selection mechanism on heterogeneous resources of the grid

PaCT'07 Proceedings of the 9th international conference on Parallel Computing Technologies

Dynamic workload balancing of parallel applications with user-level scheduling on the Grid

Future Generation Computer Systems
On the Origin of Grid Species: The Living Application

ICCS '09 Proceedings of the 9th International Conference on Computational Science: Part I
The Living Application: a Self-Organizing System for Complex Grid Tasks

International Journal of High Performance Computing Applications
A game-theoretic method of fair resource allocation for cloud computing services

The Journal of Supercomputing
The impact of heterogeneous multi-core clusters on graph partitioning: an empirical study

Cluster Computing
Internet-based Virtual Computing Environment: Beyond the data center as a computer

Future Generation Computer Systems
Dynamic load balancing of black-box applications with a resource selection mechanism on heterogeneous resources of the grid

PaCT'07 Proceedings of the 9th international conference on Parallel Computing Technologies

Quantified Score

Hi-index	0.01

Visualization

Abstract

We address the problem of porting parallel distributed applications from static homogeneous cluster environments to dynamic heterogeneous Grid resources. We introduce a generic technique for adaptive load balancing of parallel applications on heterogeneous resources and evaluate it using a case study application: a Virtual Reactor for simulation of plasma chemical vapour deposition. This application has a modular architecture with a number of loosely coupled components suitable for distribution over the Grid. It requires large parameter space exploration that allows using Grid resources for high-throughput computing. The Virtual Reactor contains a number of parallel solvers originally designed for homogeneous computer clusters that needed adaptation to the heterogeneity of the Grid. In this paper we study the performance of one of the parallel solvers, apply the technique developed for adaptive load balancing, evaluate the efficiency of this approach and outline an automated procedure for optimal utilization of heterogeneous Grid resources for high-performance parallel computing.