Selecting a Cost-Effective Test Case Prioritization Technique
Software Quality Control
Software Productivity Measurement Using Multiple Size Measures
IEEE Transactions on Software Engineering
Test prioritization for pairwise interaction coverage
A-MOST '05 Proceedings of the 1st international workshop on Advances in model-based testing
Prioritizing JUnit Test Cases: An Empirical Assessment and Cost-Benefits Analysis
Empirical Software Engineering
On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques
IEEE Transactions on Software Engineering
Using sensitivity analysis to create simplified economic models for regression testing
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
Modeling of Requirements Tracing
Balancing Agility and Formalism in Software Engineering
A prioritization approach for software test cases based on Bayesian networks
FASE'07 Proceedings of the 10th international conference on Fundamental approaches to software engineering
An evaluation of e-banking and m-banking adoption factors and preference in Malaysia: a case study
International Journal of Mobile Communications
Accounting for defect characteristics in evaluations of testing techniques
ACM Transactions on Software Engineering and Methodology (TOSEM)
Regression testing minimization, selection and prioritization: a survey
Software Testing, Verification & Reliability
Development of a framework for test case prioritization using genetic algorithm
ACM SIGSOFT Software Engineering Notes
Hi-index | 0.01 |
Test case prioritization techniques let testers order their test cases so that those with higher priority, according to some criterion, are executed earlier than those with lower priority. In previous work, we examined a variety of prioritization techniques to determine their ability to improve the rate of fault detection of test suites. Our studies showed that the rate of fault detection of test suites could be significantly improved by using more powerful prioritization techniques. In addition, they indicated that rate of fault detection was closely associated with the target program. We also observed a large quantity of unexplained variance, indicating that other factors must be affecting prioritization effectiveness. These observations motivate the following research questions: (1) Are there factors other than the target program and the prioritization technique that consistently affect the rate of fault detection of test suites? (2) What metrics are most representative of each factor? (3) Can the consideration of additional factors lead to more efficient prioritization techniques? To address these questions, we performed a series of experiments exploring three factors: program structure, test suite composition, and change characteristics. This paper reports the results and implications of those experiments.