Reviewing 25 Years of Testing Technique Experiments
Empirical Software Engineering
| Hi-index | 0.00 |
Regression test selection techniques reduce the cost of regression testing by selecting a subset of an existing test suite for reverification of a modified program. Over the past two decades, numerous regression test-selection techniques have been described in the literature. Initial empirical studies of a few of these techniques have shown that they can be beneficial, but so far, few studies have compared techniques by performing the analysis for different methods on the same set of subjects. This paper describes a comparative evaluation of different regression test-selection techniques on the same experimental subjects. In particular, the two methods DejaVu, and TestTube, developed by the authors, are evaluated and compared in terms of a cost model that considers their relative precision and efficiency. The data reveal that in some instances TestTubes relative lack of precision does not prevent it from competing with the more precise DejaVu, yet in other instances, DejaVus superior precision gives it a clear advantage over TestTube. Since TestTube requires less critical-phase time cost, such variations in performance can complicate the testers choice of which technique to use. As a result, a hybrid technique is suggested, which combines the gains in efficiency from TestTube with the increased precision of DejaVu.