Predicting the CPU availability of time-shared Unix systems on the computational grid

Authors:
Rich Wolski;Neil Spring;Jim Hayes
Affiliations:
Computer Science Department, University of Tennessee, Knoxville, TN 37996, USA;Computer Science Department, University of Washington, Seattle, WA 98195, USA;Computer Science and Engineering Department, University of California, San Diego, La Jolla, CA 92093, USA
Venue:
Cluster Computing
Year:
2000

Citing 16
Cited 21

Digital signal processing: theory, applications, and hardware

Digital signal processing: theory, applications, and hardware
On the self-similar nature of Ethernet traffic (extended version)

IEEE/ACM Transactions on Networking (TON)
Self-similarity through high-variability: statistical analysis of ethernet LAN traffic at the source level

SIGCOMM '95 Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication
MARS—a framework for minimizing the job execution time in a metacomputing environment

Future Generation Computer Systems - Special issue: resource management in distributed systems
Scheduling parallel computations in a heterogeneous environment

Scheduling parallel computations in a heterogeneous environment
Self-similarity in World Wide Web traffic: evidence and possible causes

IEEE/ACM Transactions on Networking (TON)
Application level scheduling of gene sequence comparison on metacomputers

ICS '98 Proceedings of the 12th international conference on Supercomputing
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
The network weather service: a distributed resource performance forecasting service for metacomputing

Future Generation Computer Systems - Special issue on metacomputing
Application-level scheduling on distributed heterogeneous networks

Supercomputing '96 Proceedings of the 1996 ACM/IEEE conference on Supercomputing
Implementing a performance forecasting system for metacomputing: the Network Weather Service

SC '97 Proceedings of the 1997 ACM/IEEE conference on Supercomputing
Dynamically forecasting network performance using the Network Weather Service

Cluster Computing
Modeling the Effects of Contention on the Performance of Heterogeneous Applications

HPDC '96 Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing
Performance Prediction in Production Environments

IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium
NetSolve: A Network Server for Solving Computational Science Problems

NetSolve: A Network Server for Solving Computational Science Problems
Legion: The Next Logical Step Toward a Nationwide Virtual Computer

Legion: The Next Logical Step Toward a Nationwide Virtual Computer

Automatic Construction and Evaluation of Performance Skeletons

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Performance Evaluation of Linear Algebra Routines

International Journal of High Performance Computing Applications
Building the functional performance model of a processor

Proceedings of the 2006 ACM symposium on Applied computing
A prediction method for job runtimes on shared processors: Survey, statistical analysis and new avenues

Performance Evaluation
Performance impacts of autocorrelated flows in multi-tiered systems

Performance Evaluation
Performance prediction with skeletons

Cluster Computing
Autonomic application management for large scale MPI programs

International Journal of High Performance Computing and Networking
Resource Matching in Non-dedicated Multicluster Environments

High Performance Computing for Computational Science - VECPAR 2008
Fault-aware scheduling for Bag-of-Tasks applications on Desktop Grids

GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Predicting Free Computing Capacities on Individual Machines

GPC '09 Proceedings of the 4th International Conference on Advances in Grid and Pervasive Computing
Dynamic scheduling for heterogeneous Desktop Grids

GRID '08 Proceedings of the 2008 9th IEEE/ACM International Conference on Grid Computing
Platform-independent modeling and prediction of application resource usage characteristics

Journal of Systems and Software
Discovering Piecewise Linear Models of Grid Workload

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
Dynamic scheduling for heterogeneous Desktop Grids

Journal of Parallel and Distributed Computing
Task profiling model for load profile prediction

Future Generation Computer Systems
CPU load prediction using neuro-fuzzy and Bayesian inferences

Neurocomputing
Towards Non-Stationary Grid Models

Journal of Grid Computing
An enhanced load balancing mechanism based on deadline control on GridSim

Future Generation Computer Systems
Dynamic load balancing for a grid application

HiPC'04 Proceedings of the 11th international conference on High Performance Computing
State-based predictions with self-correction on Enterprise Desktop Grid environments

Journal of Parallel and Distributed Computing
Execution time prediction for grid infrastructures based on runtime provenance data

WORKS '13 Proceedings of the 8th Workshop on Workflows in Support of Large-Scale Science

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we focus on the problem of making short and medium term forecasts of CPU availability on time-shared Unix systems. We evaluate the accuracy with which availability can be measured using Unix load average, the Unix utility vmstat, and the Network Weather Service CPU sensor that uses both. We also examine the autocorrelation between successive CPU measurements to determine their degree of self-similarity. While our observations show a long-range autocorrelation dependence, we demonstrate how this dependence manifests itself in the short and medium term predictability of the CPU resources in our study.