Experimentation in software engineering
IEEE Transactions on Software Engineering
A methodology for controlling the size of a test suite
ACM Transactions on Software Engineering and Methodology (TOSEM)
Dividing strategies for the optimization of a test suite
Information Processing Letters
Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria
ICSE '94 Proceedings of the 16th international conference on Software engineering
Semantics Guided Regression Test Cost Reduction
IEEE Transactions on Software Engineering
Pythia: a regression test selection tool based on textual differencing
ENCRESS '97 IFIP TC5 WG5.4 3rd internatinal conference on on Reliability, quality and safety of software-intensive systems
Effect of test set minimization on fault detection effectiveness
Software—Practice & Experience
Simulated annealing and genetic algorithms for optimal regression testing
Journal of Software Maintenance: Research and Practice
Test set size minimization and fault detection effectiveness: a case study in a space application
Journal of Systems and Software
An empirical study of regression test selection techniques
ACM Transactions on Software Engineering and Methodology (TOSEM)
Prioritizing Test Cases For Regression Testing
IEEE Transactions on Software Engineering
Test Case Prioritization: A Family of Empirical Studies
IEEE Transactions on Software Engineering
Genetic Algorithms in Search, Optimization and Machine Learning
Genetic Algorithms in Search, Optimization and Machine Learning
The Design and Analysis of Computer Algorithms
The Design and Analysis of Computer Algorithms
Spirit: satisfiability problem implementation for redundancy identification and test generation
ATS '00 Proceedings of the 9th Asian Test Symposium
Empirical Evaluation of the Textual Differencing Regression Testing Technique
ICSM '98 Proceedings of the International Conference on Software Maintenance
An Empirical Study of the Effects of Minimization on the Fault Detection Capabilities of Test Suites
ICSM '98 Proceedings of the International Conference on Software Maintenance
A genetic algorithm for resource-constrained scheduling
A genetic algorithm for resource-constrained scheduling
Bi-Criteria Models for All-Uses Test Suite Reduction
Proceedings of the 26th International Conference on Software Engineering
Scaling regression testing to large software systems
Proceedings of the 12th ACM SIGSOFT twelfth international symposium on Foundations of software engineering
An experimental comparison of four test suite reduction techniques
Proceedings of the 28th international conference on Software engineering
TimeAware test suite prioritization
Proceedings of the 2006 international symposium on Software testing and analysis
Search Algorithms for Regression Test Case Prioritization
IEEE Transactions on Software Engineering
Pareto efficient multi-objective test case selection
Proceedings of the 2007 international symposium on Software testing and analysis
Approximation algorithms for combinatorial problems
Journal of Computer and System Sciences
Analysis of test suite reduction with enhanced tie-breaking techniques
Information and Software Technology
Time-aware test-case prioritization using integer linear programming
Proceedings of the eighteenth international symposium on Software testing and analysis
A Bi-objective Model Inspired Greedy Algorithm for Test Suite Minimization
FGIT '09 Proceedings of the 1st International Conference on Future Generation Information Technology
Efficient multi-objective higher order mutation testing with genetic programming
Journal of Systems and Software
An empirical study on the effectiveness of time-aware test case prioritization techniques
Proceedings of the 2011 ACM Symposium on Applied Computing
A history-based cost-cognizant test case prioritization technique in regression testing
Journal of Systems and Software
Regression testing minimization, selection and prioritization: a survey
Software Testing, Verification & Reliability
On-demand test suite reduction
Proceedings of the 34th International Conference on Software Engineering
Bi-criteria test suite reduction by cluster analysis of execution profiles
CEE-SET'09 Proceedings of the 4th IFIP TC 2 Central and East European conference on Advances in Software Engineering Techniques
Is this a bug or an obsolete test?
ECOOP'13 Proceedings of the 27th European conference on Object-Oriented Programming
Generating test data for both path coverage and fault detection using genetic algorithms
Frontiers of Computer Science: Selected Publications from Chinese Universities
Hi-index | 0.00 |
In software development, developers often rely on testing to reveal bugs. Typically, a test suite should be prepared before initial testing, and new test cases may be added to the test suite during the whole testing process. This may usually cause the test suite to contain more or less redundancy. In other words, a subset of the test suite (called the representative set) may still satisfy all the test objectives. As the redundancy can increase the cost of executing the test suite, quite a few test suite reduction techniques have been brought out in spite of the NP-completeness of the general problem of finding the optimal representative set of a test suite. In the literature, there have been some experimental studies of test suite reduction techniques, but the limitations of the these experimental studies are quite obvious. Recently proposed techniques are not experimentally compared against each other, and reported experiments are mainly based on small programs or even simulation data. This paper presents a new experimental study of the four typical test suite reduction techniques, including Harrold et al.'s heuristic, and three other recently proposed techniques such as Chen and Lau's GRE heuristic, Mansour and El-Fakin's genetic algorithm-based approach, and Black et al.'s ILP-based approach. Based on the results of this experimental study, we also provide a guideline for choosing the appropriate test suite reduction technique and some insights into why the techniques vary in effectiveness and efficiency.