Run-Time Statistical Estimation of Task Execution Times for Heterogeneous Distributed Computing

Authors:
Michael A. Iverson;Fusun Ozguner;Gregory J. Follen
Affiliations:
-;-;-
Venue:
HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
Year:
1996

Citing 11
Cited 17

Optimal selection theory for superconcurrency

Proceedings of the 1989 ACM/IEEE conference on Supercomputing
An analytical approach to performance/cost modeling of parallel computers

Journal of Parallel and Distributed Computing
Graphical development tools for network-based concurrent supercomputing

Proceedings of the 1991 ACM/IEEE conference on Supercomputing
Parallel computing (2nd ed.): theory and practice

Parallel computing (2nd ed.): theory and practice
Static dependent costs for estimating execution time

LFP '94 Proceedings of the 1994 ACM conference on LISP and functional programming
Guest Editor's Introduction: Heterogeneous Processing

Computer
Heterogeneous Computing: Challenges and Opportunities

Computer
Visualization and Debugging in a Heterogeneous Environment

Computer
Load Sharing with Consideration of Future Task Arrivals in Heterogeneous Distributed Real-Time Systems

IEEE Transactions on Computers
Design and Evaluation of Effective Load Sharing in Distributed Real-Time Systems

IEEE Transactions on Parallel and Distributed Systems
Estimation of Execution times on Heterogeneous Supercomputer Architectures

ICPP '93 Proceedings of the 1993 International Conference on Parallel Processing - Volume 01

Statistical Prediction of Task Execution Times through Analytic Benchmarking for Scheduling in a Heterogeneous Environment

IEEE Transactions on Computers
Stochastic Prediction of Execution Time for Dynamic Bulk Synchronous Computations

The Journal of Supercomputing
Stochastic Prediction of Execution Time for Dynamic Bulk Synchronous Computations

IPDPS '01 Proceedings of the 15th International Parallel & Distributed Processing Symposium
Statistical Prediction of Task Execution Times Through Analytic Benchmarking for Scheduling in a Heterogeneous Environment

HCW '99 Proceedings of the Eighth Heterogeneous Computing Workshop
Trace-based evaluation of job runtime and queue wait time predictions in grids

Proceedings of the 18th ACM international symposium on High performance distributed computing
A Hybrid Intelligent Method for Performance Modeling and Prediction of Workflow Activities in Grids

CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
Energy aware scheduling on desktop grid environment with static performance prediction

SpringSim '09 Proceedings of the 2009 Spring Simulation Multiconference
An evaluation of the benefits of fine-grained value-based scheduling on general purpose clusters

Future Generation Computer Systems
An evaluation of the benefits of fine-grained value-based scheduling on general purpose clusters

Future Generation Computer Systems
Combining Futures and Spot Markets: A Hybrid Market Approach to Economic Grid Resource Management

Journal of Grid Computing
Dynamic application model for scheduling with uncertainty on reconfigurable architectures

International Journal of Reconfigurable Computing - Special issue on selected papers from the international workshop on reconfigurable communication-centric systems on chips (ReCoSoC' 2010)
An Analysis of Provisioning and Allocation Policies for Infrastructure-as-a-Service Clouds

CCGRID '12 Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)
Online execution time prediction for computationally intensive applications with periodic progress updates

The Journal of Supercomputing
A fuzzy logic approach for secure and fault tolerant grid job scheduling

ATC'07 Proceedings of the 4th international conference on Autonomic and Trusted Computing
Automatic selection of processing units for coprocessing in databases

ADBIS'12 Proceedings of the 16th East European conference on Advances in Databases and Information Systems
Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds

Future Generation Computer Systems
Efficient co-processor utilization in database query processing

Information Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, an efficient, run-time, statistical scheme for estimating the execution time of a task is presented, in order to facilitate run-time matching and scheduling in a distributed heterogeneous computing environment. This scheme is based upon a nonparametric regression technique, where the execution time estimate for a task is computed from past observations. Furthermore, this technique is able to compensate for different parameters upon which the execution time depends, and does not require any knowledge of the architecture of the target machine. It is also able to make accurate predictions when erroneous data is present in the set of observations, and has been experimentally shown to produce estimates with very low error, even with few past values from which to calculate a new estimate.