Algorithm-system scalability of heterogeneous computing

Authors:
Yong Chen;Xian-He Sun;Ming Wu
Affiliations:
Department of Computer Science, Illinois Institute of Technology, Chicago, IL 60616, USA;Department of Computer Science, Illinois Institute of Technology, Chicago, IL 60616, USA;Department of Computer Science, Illinois Institute of Technology, Chicago, IL 60616, USA
Venue:
Journal of Parallel and Distributed Computing
Year:
2008

Citing 17
Cited 4

Introduction to parallel computing: design and analysis of algorithms

Introduction to parallel computing: design and analysis of algorithms
Scalable problems and memory-bounded speedup

Journal of Parallel and Distributed Computing
Latency metric: an experimental method for measuring and evaluating parallel program and architecture scalability

Journal of Parallel and Distributed Computing - Special issue on scalability of parallel algorithms and architectures
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
Evaluating the Scalability of Distributed Systems

IEEE Transactions on Parallel and Distributed Systems
Heterogeneous distribution of computations solving linear algebra problems on networks of heterogeneous computers

Journal of Parallel and Distributed Computing
Matrix Multiplication on Heterogeneous Platforms

IEEE Transactions on Parallel and Distributed Systems
Parallel Computer Architecture: A Hardware/Software Approach

Parallel Computer Architecture: A Hardware/Software Approach
Scalability versus execution time in scalable systems

Journal of Parallel and Distributed Computing
Automated Scalability Analysis of Message-Passing Parallel Programs

IEEE Parallel & Distributed Technology: Systems & Technology
Performance Prediction: A Case Study Using a Scalable Shared-Virtual-Memory Machine

IEEE Parallel & Distributed Technology: Systems & Technology
Scalability of Parallel Algorithm-Machine Combinations

IEEE Transactions on Parallel and Distributed Systems
An efficiency and scalability model for heterogeneous clusters.

CLUSTER '01 Proceedings of the 3rd IEEE International Conference on Cluster Computing
Modeling and characterizing parallel computing performance on heterogeneous networks of workstations

SPDP '95 Proceedings of the 7th IEEE Symposium on Parallel and Distributeed Processing
Scalability of Heterogeneous Computing

ICPP '05 Proceedings of the 2005 International Conference on Parallel Processing
Theoretical scalability analysis for heterogeneous clusters

CCGRID '04 Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid
Scalability of Parallel Algorithms for Matrix Multiplication

ICPP '93 Proceedings of the 1993 International Conference on Parallel Processing - Volume 03

Parallel exact inference on the Cell Broadband Engine processor

Journal of Parallel and Distributed Computing
Scalability limits of Bag-of-Tasks applications running on hierarchical platforms

Journal of Parallel and Distributed Computing
Automatic tuning of iterative computation on heterogeneous multiprocessors with ADITHE

The Journal of Supercomputing
A load index and load balancing algorithm for heterogeneous clusters

The Journal of Supercomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Scalability is a key factor of the design of distributed systems and parallel algorithms and machines. However, conventional scalabilities are designed for homogeneous parallel processing. There is no suitable and commonly accepted definition of scalability metric for heterogeneous systems. Isospeed scalability is a well-defined metric for homogeneous computing. This study extends the isospeed scalability metric to general heterogeneous computing systems. The proposed isospeed-efficiency model is suitable for both homogeneous and heterogeneous computing. Through theoretical analyses, we derive methodologies of scalability measurement and prediction for heterogeneous systems. Experimental results have verified the analytical results and confirmed that the proposed isospeed-efficiency scalability works well in both homogeneous and heterogeneous environments.