Hierarchical partitioning and dynamic load balancing for scientific computation

Authors:
James D. Teresco;Jamal Faik;Joseph E. Flaherty
Affiliations:
Department of Computer Science, Williams College, Williamstown, MA;Department of Computer Science, Rensselaer Polytechnic Institute, Troy, NY;Department of Computer Science, Rensselaer Polytechnic Institute, Troy, NY
Venue:
PARA'04 Proceedings of the 7th international conference on Applied Parallel Computing: state of the Art in Scientific Computing
Year:
2004

Citing 17
Cited 3

A Partitioning Strategy for Nonuniform Problems on Multiprocessors

IEEE Transactions on Computers
Dynamic load balancing for distributed memory multiprocessors

Journal of Parallel and Distributed Computing
Partitioning sparse matrices with eigenvectors of graphs

SIAM Journal on Matrix Analysis and Applications
Performance of dynamic load balancing algorithms for unstructured mesh calculations

Concurrency: Practice and Experience
A parallel hashed Oct-Tree N-body algorithm

Proceedings of the 1993 ACM/IEEE conference on Supercomputing
Parallel, adaptive finite element methods for conservation laws

Proceedings of the third ARO workshop on Adaptive methods for partial differential equations
A multilevel algorithm for partitioning graphs

Supercomputing '95 Proceedings of the 1995 ACM/IEEE conference on Supercomputing
Dynamic Partitioning of Non-Uniform Structured Workloads with Spacefilling Curves

IEEE Transactions on Parallel and Distributed Systems
A high-performance, portable implementation of the MPI message passing interface standard

Parallel Computing
Adaptive local refinement with octree load balancing for the parallel solution of three-dimensional conservation laws

Journal of Parallel and Distributed Computing - Special issue on dynamic load balancing
A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs

SIAM Journal on Scientific Computing
Parallel Multilevel series k-Way Partitioning Scheme for Irregular Graphs

SIAM Review
A Programming Methodology for Dual-Tier Multicomputers

IEEE Transactions on Software Engineering - Special issue on architecture-independent languages and software tools for parallel processing
Parallel optimisation algorithms for multilevel mesh partitioning

Parallel Computing - Special issue on graph partioning and parallel computing
Zoltan Data Management Service for Parallel Dynamic Applications

Computing in Science and Engineering
Resource-Aware Scientific Computation on a Heterogeneous Cluster

Computing in Science and Engineering
New challenges in dynamic load balancing

Applied Numerical Mathematics - Adaptive methods for partial differential equations and large-scale computation

Hybrid Runtime Management of Space-Time Heterogeneity for Parallel Structured Adaptive Applications

IEEE Transactions on Parallel and Distributed Systems
Graph partitioning using improved ant clustering

ICSI'10 Proceedings of the First international conference on Advances in Swarm Intelligence - Volume Part I
The impact of heterogeneous multi-core clusters on graph partitioning: an empirical study

Cluster Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Cluster and grid computing has made hierarchical and heterogeneous computing systems increasingly common as target environments for large-scale scientific computation. A cluster may consist of a network of multiprocessors. A grid computation may involve communication across slow interfaces. Modern supercomputers are often large clusters with hierarchical network structures. For maximum efficiency, software must adapt to the computing environment. We focus on partitioning and dynamic load balancing, in particular on hierarchical procedures implemented within the Zoltan Toolkit, guided by DRUM, the Dynamic Resource Utilization Model. Here, different balancing procedures are used in different parts of the domain. Preliminary results show that hierarchical partitionings are competitive with the best traditional methods on a small hierarchical cluster.