A methodology for controlling the size of a test suite
ACM Transactions on Software Engineering and Methodology (TOSEM)
Effect of test set minimization on fault detection effectiveness
Proceedings of the 17th international conference on Software engineering
An empirical study of regression test selection techniques
ACM Transactions on Software Engineering and Methodology (TOSEM)
Incorporating varying test costs and fault severities into test case prioritization
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
Prioritizing Test Cases For Regression Testing
IEEE Transactions on Software Engineering
Test Case Prioritization: A Family of Empirical Studies
IEEE Transactions on Software Engineering
Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage
IEEE Transactions on Software Engineering
Improving web application testing with user session data
Proceedings of the 25th International Conference on Software Engineering
Test Case Prioritization: An Empirical Study
ICSM '99 Proceedings of the IEEE International Conference on Software Maintenance
Bi-Criteria Models for All-Uses Test Suite Reduction
Proceedings of the 26th International Conference on Software Engineering
Selecting a Cost-Effective Test Case Prioritization Technique
Software Quality Control
A Scalable Approach to User-Session based Testing of Web Applications through Concept Analysis
Proceedings of the 19th IEEE international conference on Automated software engineering
Test-Suite Reduction for Model Based Tests: Effects on Test Quality and Implications for Testing
Proceedings of the 19th IEEE international conference on Automated software engineering
On test suite composition and cost-effective regression testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
Leveraging User-Session Data to Support Web Application Testing
IEEE Transactions on Software Engineering
Test Suite Reduction with Selective Redundancy
ICSM '05 Proceedings of the 21st IEEE International Conference on Software Maintenance
ICSM '05 Proceedings of the 21st IEEE International Conference on Software Maintenance
Automated replay and failure detection for web applications
Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering
Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering
Web Application Testing with Customized Test Requirements - An Experimental Comparison Study
ISSRE '06 Proceedings of the 17th International Symposium on Software Reliability Engineering
Using Mutation Analysis for Assessing and Comparing Testing Coverage Criteria
IEEE Transactions on Software Engineering
Pareto efficient multi-objective test case selection
Proceedings of the 2007 international symposium on Software testing and analysis
Applying Concept Analysis to User-Session-Based Testing of Web Applications
IEEE Transactions on Software Engineering
Automated Oracle Comparators for TestingWeb Applications
ISSRE '07 Proceedings of the The 18th IEEE International Symposium on Software Reliability
Call-Stack Coverage for GUI Test Suite Reduction
IEEE Transactions on Software Engineering
Prioritizing User-Session-Based Test Cases for Web Applications Testing
ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation
An empirical study of the effect of time constraints on the cost-benefits of regression testing
Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering
Analysis of test suite reduction with enhanced tie-breaking techniques
Information and Software Technology
MINTS: A general framework and tool for supporting test-suite minimization
ICSE '09 Proceedings of the 31st International Conference on Software Engineering
A systematic review on regression test selection techniques
Information and Software Technology
Using hybrid algorithm for Pareto efficient multi-objective test suite minimisation
Journal of Systems and Software
Developing a Single Model and Test Prioritization Strategies for Event-Driven Software
IEEE Transactions on Software Engineering
A tool for combination-based prioritization and reduction of user-session-based test suites
ICSM '11 Proceedings of the 2011 27th IEEE International Conference on Software Maintenance
MICAI'12 Proceedings of the 11th Mexican international conference on Advances in Computational Intelligence - Volume Part II
Hi-index | 0.00 |
Context: Test suite reduction is the problem of creating and executing a set of test cases that are smaller in size but equivalent in effectiveness to an original test suite. However, reduced suites can still be large and executing all the tests in a reduced test suite can be time consuming. Objective: We propose ordering the tests in a reduced suite to increase its rate of fault detection. The ordered reduced test suite can be executed in time constrained situations, where, even if test execution is stopped early, the best test cases from the reduced suite will already be executed. Method: In this paper, we present several approaches to order reduced test suites using experimentally verified prioritization criteria for the domain of web applications. We conduct an empirical study with three subject applications and user-session-based test cases to demonstrate how ordered reduced test suites often make a practical contribution. To enable comparison between test suites of different sizes, we develop Mod_APFD_C, a modification of the traditional prioritization effectiveness measure. Results: We find that by ordering the reduced suites, we create test suites that are more effective than unordered reduced suites. In each of our subject applications, there is at least one ordered reduced suite that outperforms the best unordered reduced suite and the best prioritized original suite. Conclusions: Our results show that when a tester does not have enough time to execute the entire reduced suite, executing an ordered reduced suite often improves the rate of fault detection. By coupling the underlying system's characteristics with observations from our study on the criteria that produce the best ordered reduced suites, a tester can order their reduced test suites to obtain increased testing effectiveness.