Load prediction using hybrid model for computational grid

Authors:
Yongwei Wu;Yulai Yuan;Guangwen Yang;Weimin Zheng
Affiliations:
Department of Computer Science and Technology, Tsinghua University, Being 100084, China;Department of Computer Science and Technology, Tsinghua University, Being 100084, China;Department of Computer Science and Technology, Tsinghua University, Being 100084, China;Department of Computer Science and Technology, Tsinghua University, Being 100084, China
Venue:
GRID '07 Proceedings of the 8th IEEE/ACM International Conference on Grid Computing
Year:
2007

Citing 14
Cited 7

Digital spectral analysis: with applications

Digital spectral analysis: with applications
Introduction to signal processing

Introduction to signal processing
The grid: blueprint for a new computing infrastructure

The grid: blueprint for a new computing infrastructure
Dynamically forecasting network performance using the Network Weather Service

Cluster Computing
Host load prediction using linear models

Cluster Computing
Predicting the CPU Availability of Time-Shared Unix Systems on the Computational Grid

HPDC '99 Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing
Design and Evaluation of a Resource Selection Framework for Grid Applications

HPDC '02 Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing
Homeostatic and Tendency-Based CPU Load Predictions

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Performance Prediction in Production Environments

IPPS '98 Proceedings of the 12th. International Parallel Processing Symposium on International Parallel Processing Symposium
Size-Based Scheduling Policies with Inaccurate Scheduling Information

MASCOTS '04 Proceedings of the The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems
Adaptive multi-resource prediction in distributed resource sharing environment

CCGRID '04 Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid
Extended forecast of CPU and network load on computational Grid

CCGRID '04 Proceedings of the 2004 IEEE International Symposium on Cluster Computing and the Grid
CPU Load Predictions on the Computational Grid *

CCGRID '06 Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid
Predicting Running Time of Grid Tasks based on CPU Load Predictions

GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing

A novel statistical time-series pattern based interval forecasting strategy for activity durations in workflow systems

Journal of Systems and Software
Efficient dynamic task scheduling in virtualized data centers with fuzzy prediction

Journal of Network and Computer Applications
An effective data aggregation based adaptive long term CPU load prediction mechanism on computational grid

Future Generation Computer Systems
Resource optimization in distributed real-time multimedia applications

Multimedia Tools and Applications
A dynamic and adaptive load balancing strategy for parallel file system with large-scale I/O servers

Journal of Parallel and Distributed Computing
Host load prediction in a Google compute cloud with a Bayesian model

SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
Google hostload prediction based on Bayesian model with optimized feature combination

Journal of Parallel and Distributed Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Due to the dynamic nature of grid environments, schedule algorithms always need assistance of a long-time-ahead load prediction to make decisions on how to use grid resources efficiently. In this paper, we present and evaluate a new hybrid model, which predicts the n-step-ahead load status by using interval values. This model integrates autoregressive (AR) model with confidence interval estimations to forecast the future load of a system. Meanwhile, two filtering technologies from signal processing field are also introduced into this model to eliminate data noise and enhance prediction accuracy. The results of experiments conducted on a real grid environment demonstrate that this new model is more capable of predicting n-step-ahead load in a computational grid than previous works. The proposed hybrid model performs well on prediction advance time for up to 50 minutes, with significant less prediction errors than conventional AR model. It also achieves an interval length acceptable for task scheduler.