Prioritizing test cases for regression testing
Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
Evidence-Based Software Engineering
Proceedings of the 26th International Conference on Software Engineering
On the economics of requirements-based test case prioritization
EDSER '05 Proceedings of the seventh international workshop on Economics-driven software engineering research
Empirical Software Engineering
Prioritizing JUnit Test Cases: An Empirical Assessment and Cost-Benefits Analysis
Empirical Software Engineering
A Systematic Review of Software Development Cost Estimation Studies
IEEE Transactions on Software Engineering
Using coverage effectiveness to evaluate test suite prioritizations
Proceedings of the 1st ACM international workshop on Empirical assessment of software engineering languages and technologies: held in conjunction with the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE) 2007
Empirical evaluations of regression test selection techniques: a systematic review
Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
Systematic literature reviews in software engineering - A systematic literature review
Information and Software Technology
Test Case Prioritization Based on Analysis of Program Structure
APSEC '08 Proceedings of the 2008 15th Asia-Pacific Software Engineering Conference
Information and Software Technology
Review: A systematic review of software fault prediction studies
Expert Systems with Applications: An International Journal
Experimental Comparison of Code-Based and Model-Based Test Prioritization
ICSTW '09 Proceedings of the IEEE International Conference on Software Testing, Verification, and Validation Workshops
A systematic review on regression test selection techniques
Information and Software Technology
The Effects of Time Constraints on Test Case Prioritization: A Series of Controlled Experiments
IEEE Transactions on Software Engineering
ICSTW '11 Proceedings of the 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops
The value of mapping studies: a participantobserver case study
EASE'10 Proceedings of the 14th international conference on Evaluation and Assessment in Software Engineering
Systematic mapping studies in software engineering
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
Regression testing minimization, selection and prioritization: a survey
Software Testing, Verification & Reliability
Hi-index | 0.00 |
Test case prioritization techniques, which are used to improve the cost-effectiveness of regression testing, order test cases in such a way that those cases that are expected to outperform others in detecting software faults are run earlier in the testing phase. The objective of this study is to examine what kind of techniques have been widely used in papers on this subject, determine which aspects of test case prioritization have been studied, provide a basis for the improvement of test case prioritization research, and evaluate the current trends of this research area. We searched for papers in the following five electronic databases: IEEE Explorer, ACM Digital Library, Science Direct, Springer, and Wiley. Initially, the search string retrieved 202 studies, but upon further examination of titles and abstracts, 120 papers were identified as related to test case prioritization. There exists a large variety of prioritization techniques in the literature, with coverage-based prioritization techniques (i.e., prioritization in terms of the number of statements, basic blocks, or methods test cases cover) dominating the field. The proportion of papers on model-based techniques is on the rise, yet the growth rate is still slow. The proportion of papers that use datasets from industrial projects is found to be 64 %, while those that utilize public datasets for validation are only 38 %. On the basis of this study, the following recommendations are provided for researchers: (1) Give preference to public datasets rather than proprietary datasets; (2) develop more model-based prioritization methods; (3) conduct more studies on the comparison of prioritization methods; (4) always evaluate the effectiveness of the proposed technique with well-known evaluation metrics and compare the performance with the existing methods; (5) publish surveys and systematic review papers on test case prioritization; and (6) use datasets from industrial projects that represent real industrial problems.