Probability, random processes, and estimation theory for engineers
Probability, random processes, and estimation theory for engineers
Predictability of Process Resource Usage: A Measurement-Based Study on UNIX
IEEE Transactions on Software Engineering
Optimal selection theory for superconcurrency
Proceedings of the 1989 ACM/IEEE conference on Supercomputing
PAWS: A Performance Evaluation Tool for Parallel Computing Systems
Computer - Special issue on experimental research in computer architecture
Run-Time Statistical Estimation of Task Execution Times for Heterogeneous Distributed Computing
HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
IEEE Transactions on Parallel and Distributed Systems
GRID '02 Proceedings of the Third International Workshop on Grid Computing
Stress testing real-time systems with genetic algorithms
GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Scheduling of a meta-task with QoS requirements in heterogeneous computing systems
Journal of Parallel and Distributed Computing
PGGA: a predictable and grouped genetic algorithm for job scheduling
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
Adjusted fair scheduling and non-linear workload prediction for QoS guarantees in grid computing
Computer Communications
Journal of Parallel and Distributed Computing
On the performance-driven load distribution for heterogeneous computational grids
Journal of Computer and System Sciences
Stochastic robustness metric and its use for static resource allocations
Journal of Parallel and Distributed Computing
The Journal of Supercomputing
Scheduling in a dynamic heterogeneous distributed system using estimation error
Journal of Parallel and Distributed Computing
Prediction-based real-time resource provisioning for massively multiplayer online games
Future Generation Computer Systems
Modeling Job Lifespan Delays in Volunteer Computing Projects
CCGRID '09 Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid
PGGA: A predictable and grouped genetic algorithm for job scheduling
Future Generation Computer Systems - Parallel input/output management techniques (PIOMT) in cluster and grid computing
Future Generation Computer Systems
An evaluation of the benefits of fine-grained value-based scheduling on general purpose clusters
Future Generation Computer Systems
An evaluation of the benefits of fine-grained value-based scheduling on general purpose clusters
Future Generation Computer Systems
RMOT: recursion in model order for task execution time estimation in a software pipeline
Proceedings of the Conference on Design, Automation and Test in Europe
DAGS: distribution agnostic sequential Monte Carlo scheme for task execution time estimation
Proceedings of the Conference on Design, Automation and Test in Europe
A game-theoretic method of fair resource allocation for cloud computing services
The Journal of Supercomputing
A task duplication based bottom-up scheduling algorithm for heterogeneous environments
IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
Combining Futures and Spot Markets: A Hybrid Market Approach to Economic Grid Resource Management
Journal of Grid Computing
Two iterative metaheuristic approaches to dynamic memory allocation for embedded systems
EvoCOP'11 Proceedings of the 11th European conference on Evolutionary computation in combinatorial optimization
Proceedings of the 48th Design Automation Conference
A hybrid heuristic-genetic algorithm for task scheduling in heterogeneous processor networks
Journal of Parallel and Distributed Computing
A mathematical model and a metaheuristic approach for a memory allocation problem
Journal of Heuristics
Proceedings of the International Conference on Computer-Aided Design
A method for estimating the execution time of a parallel task on a grid node
EGC'05 Proceedings of the 2005 European conference on Advances in Grid Computing
The Journal of Supercomputing
A fuzzy logic approach for secure and fault tolerant grid job scheduling
ATC'07 Proceedings of the 4th international conference on Autonomic and Trusted Computing
Stochastic Tail-Phase Optimization for Bag-of-Tasks Execution in Clouds
UCC '12 Proceedings of the 2012 IEEE/ACM Fifth International Conference on Utility and Cloud Computing
Online cost-efficient scheduling of deadline-constrained workloads on hybrid clouds
Future Generation Computer Systems
| Hi-index | 14.99 |
In this paper, a method for estimating task execution times is presented in order to facilitate dynamic scheduling in a heterogeneous metacomputing environment. Execution time is treated as a random variable and is statistically estimated from past observations. This method predicts the execution time as a function of several parameters of the input data and does not require any direct information about the algorithms used by the tasks or the architecture of the machines. Techniques based upon the concept of analytic benchmarking/code profiling [1] are used to characterize the performance differences between machines, allowing observations from dissimilar machines to be used when making a prediction. Experimental results are presented which use actual execution time data gathered from $16$ heterogeneous machines.