Load sharing in soft real-time distributed computer systems
IEEE Transactions on Computers - Special Issue on Real-Time Systems
The limited performance benefits of migrating active processes for load sharing
SIGMETRICS '88 Proceedings of the 1988 ACM SIGMETRICS conference on Measurement and modeling of computer systems
The available capacity of a privately owned workstation environment
Performance Evaluation
On the self-similar nature of Ethernet traffic
SIGCOMM '93 Conference proceedings on Communications architectures, protocols and applications
Analysis, modeling and generation of self-similar VBR video traffic
SIGCOMM '94 Proceedings of the conference on Communications architectures, protocols and applications
SIGCOMM '95 Proceedings of the conference on Applications, technologies, architectures, and protocols for computer communication
Exploiting process lifetime distributions for dynamic load balancing
Proceedings of the 1996 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Load-balancing heuristics and process behavior
SIGMETRICS '86/PERFORMANCE '86 Proceedings of the 1986 ACM SIGMETRICS joint international conference on Computer performance modelling, measurement and evaluation
Time Series Analysis: Forecasting and Control
Time Series Analysis: Forecasting and Control
An Evaluation of Linear Models for Host Load Prediction
HPDC '99 Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing
ICDCS '97 Proceedings of the 17th International Conference on Distributed Computing Systems (ICDCS '97)
Dome: Parallel Programming in a Heterogeneous Multi-User Environment
Dome: Parallel Programming in a Heterogeneous Multi-User Environment
A Comparison of Queueing, Cluster and Distributed Computing Systems
A Comparison of Queueing, Cluster and Distributed Computing Systems
Online prediction of the running time of tasks
Proceedings of the 2001 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Host load prediction using linear models
Cluster Computing
Online Prediction of the Running Time of Tasks
Cluster Computing
A Prediction-Based Real-Time Scheduling Advisor
IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Realistic CPU Workloads through Host Load Trace Playback
LCR '00 Selected Papers from the 5th International Workshop on Languages, Compilers, and Run-Time Systems for Scalable Computers
Grid resource management
Performance Evaluation - Special issue: Distributed systems performance
Resource Management for Rapid Application Turnaround on Enterprise Desktop Grids
Proceedings of the 2004 ACM/IEEE conference on Supercomputing
IEEE Transactions on Parallel and Distributed Systems
Characterizing resource availability in enterprise desktop grids
Future Generation Computer Systems
The user in experimental computer systems research
Proceedings of the 2007 workshop on Experimental computer science
The user in experimental computer systems research
ecs'07 Experimental computer science on Experimental computer science
Time Jails: A Hybrid Approach to Scalable Network Emulation
Proceedings of the 22nd Workshop on Principles of Advanced and Distributed Simulation
Availability Traces of Enterprise Desktop Grids
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Proceedings of the First Asia-Pacific Symposium on Internetware
Enhancing the efficiency of resource usage on opportunistic grids
Proceedings of the 7th International Workshop on Middleware for Grids, Clouds and e-Science
Display power management policies in practice
Proceedings of the 7th international conference on Autonomic computing
Using network information to perform meta-scheduling in advance in grids
EuroPar'10 Proceedings of the 16th international Euro-Par conference on Parallel processing: Part I
Task profiling model for load profile prediction
Future Generation Computer Systems
Network-aware meta-scheduling in advance with autonomous self-tuning system
Future Generation Computer Systems
GRID '11 Proceedings of the 2011 IEEE/ACM 12th International Conference on Grid Computing
Wave scheduler: scheduling for faster turnaround time in peer-based desktop grid systems
JSSPP'05 Proceedings of the 11th international conference on Job Scheduling Strategies for Parallel Processing
On the Improvement of Grid Resource Utilization: Preventive and Reactive Rescheduling Approaches
Journal of Grid Computing
ADNTIIC'11 Proceedings of the Second international conference on Advances in New Technologies, Interactive Interfaces and Communicability
| Hi-index | 0.00 |
Understanding how host load changes over time is instrumental in predicting the execution time of tasks or jobs, such as in dynamic load balancing and distributed soft real-time systems. To improve this understanding, we collected week-long, 1 Hz resolution traces of the Digital Unix 5 second exponential load average on over 35 different machines including production and research cluster machines, compute servers, and desktop workstations. Separate sets of traces were collected at two different times of the year. The traces capture all of the dynamic load information available to user-level programs on these machines. We present a detailed statistical analysis of these traces here, including summary statistics, distributions, and time series analysis results. Two significant new results are that load is self-similar and that it displays epochal behavior. All of the traces exhibit a high degree of self-similarity with Hurst parameters ranging from 0.73 to 0.99, strongly biased toward the top of that range. The traces also display epochal behavior in that the local frequency content of the load signal remains quite stable for long periods of time (150-450 s mean) and changes abruptly at epoch boundaries. Despite these complex behaviors, we have found that relatively simple linear models are sufficient for short-range host load prediction.