Modeling the Cost-Benefits Tradeoffs for Regression Testing Techniques

  • Authors:
  • Affiliations:
  • Venue:
  • ICSM '02 Proceedings of the International Conference on Software Maintenance (ICSM'02)
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

Regression testing is an expensive activity that can accountfor a large proportion of the software maintenancebudget. Because engineers add tests into test suites as softwareevolves, over time, increased test suite size makesrevalidation of the software more expensive. Regression testselection, test suite reduction, and test case prioritizationtechniques can help with this, by reducing the number of regressiontests that must be run and by helping testers meettesting objectives more quickly. These techniques, however,can be expensive to employ and may not reduce overall regressiontesting costs. Thus, practitioners and researcherscould benefit from cost models that would help them assessthe cost-benefits of techniques. Cost models have beenproposed for this purpose, but some of these models omitimportant factors, and others cannot truly evaluate cost-effectiveness.In this paper, we present new cost-benefitsmodels for regression test selection, test suite reduction, andtest case prioritization, that capture previously omitted factors,and support cost-benefits analyses where they were notsupported before. We present the results of an empiricalstudy assessing these models.