An Approach to On-line Predictive Detection

  • Authors:
  • Fan Zhang;Joseph L. Hellerstein

  • Affiliations:
  • -;-

  • Venue:
  • MASCOTS '00 Proceedings of the 8th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

Predicting network performance problems enables network operators to take corrective actions in advance of service disruptions. Typically, service problems are detected by tests that compare a metric (e.g., response time) to a threshold. Herein, we present an on-line algorithm for predicting the probability of threshold violations over a time horizon. Our algorithm uses two cascaded submodels. The first removes non-stationarities by employing a discrete time Kalman Filter in combination with analysis of variance. We derive parameters of the Kalman Filter from differential equations that describe characteristics of the data. The second sub-model estimates the probability of threshold violations by using a second order autoregressive model in combination with change-point detection. Using data from a production web server, we evaluate our approach and show that it produces average accuracies that are comparable to those of an off-line algorithm. However, our on-line algorithm produces predictions with considerably smaller variances. Further advantages of our approach are: (a) requiring much less data than the off-line technique-one day versus multiple months; and (b) adapting to changes in the system and workloads since parameters are estimated on-line.