A Calibration Framework for Capturing and Calibrating Software Performance Models

  • Authors:

  • Xiuping Wu;Murray Woodside

  • Affiliations:

  • Dept. of Systems & Computer Eng., Carleton University, Ottawa, Canada K1S 5B6;Dept. of Systems & Computer Eng., Carleton University, Ottawa, Canada K1S 5B6

  • Venue:
  • EPEW '08 Proceedings of the 5th European Performance Engineering Workshop on Computer Performance Engineering
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Software performance engineering could benefit from combining modeling and testing techniques, if performance models could be derived more cheaply and more easily. This work investigates how known testing and estimation methodologies can be combined in a calibration framework, to provide and maintain performance models in sync with a developing product or component library. There are two main aspects. The first addresses a major barrier in practice, the calibration of model parameters that represent quantities that cannot easily be measured directly. This work calibrates these "hidden parameters" efficiently using a Kalman Filter. The second is the exploitation of the filter estimator to control the calibration framework, for example to terminate a test when accuracy is sufficient, and to design tests for parameter coverage. The technique is demonstrated on simulated data and on an implemented Voice-over-IP (VoIP) system.