A methodology for controlling the size of a test suite
ACM Transactions on Software Engineering and Methodology (TOSEM)
Dividing strategies for the optimization of a test suite
Information Processing Letters
A safe, efficient regression test selection technique
ACM Transactions on Software Engineering and Methodology (TOSEM)
Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria
ICSE '94 Proceedings of the 16th international conference on Software engineering
TestTube: a system for selective regression testing
ICSE '94 Proceedings of the 16th international conference on Software engineering
Regression testing in an industrial environment
Communications of the ACM
Design, implementation, and evaluation of optimizations in a just-in-time compiler
JAVA '99 Proceedings of the ACM 1999 conference on Java Grande
Refactoring: improving the design of existing code
Refactoring: improving the design of existing code
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
Prioritizing test cases for regression testing
Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
Incorporating varying test costs and fault severities into test case prioritization
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
Prioritizing Test Cases For Regression Testing
IEEE Transactions on Software Engineering
Test Case Prioritization: A Family of Empirical Studies
IEEE Transactions on Software Engineering
Effectively prioritizing tests in development environment
ISSTA '02 Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis
Proceedings of the 24th International Conference on Software Engineering
The impact of test suite granularity on the cost-effectiveness of regression testing
Proceedings of the 24th International Conference on Software Engineering
Understanding and Measuring the Sources of Variation in the Prioritization of Regression Test Suites
METRICS '01 Proceedings of the 7th International Symposium on Software Metrics
Test Case Prioritization: An Empirical Study
ICSM '99 Proceedings of the IEEE International Conference on Software Maintenance
A Study of Effective Regression Testing in Practice
ISSRE '97 Proceedings of the Eighth International Symposium on Software Reliability Engineering
Modeling the Cost-Benefits Tradeoffs for Regression Testing Techniques
ICSM '02 Proceedings of the International Conference on Software Maintenance (ICSM'02)
Reducing wasted development time via continuous testing
ISSRE '03 Proceedings of the 14th International Symposium on Software Reliability Engineering
An experimental evaluation of continuous testing during development
ISSTA '04 Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis
Selecting a Cost-Effective Test Case Prioritization Technique
Software Quality Control
On test suite composition and cost-effective regression testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
Is mutation an appropriate tool for testing experiments?
Proceedings of the 27th international conference on Software engineering
Proceedings of the 27th international conference on Software engineering
Empirical Software Engineering
Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering
On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques
IEEE Transactions on Software Engineering
Using sensitivity analysis to create simplified economic models for regression testing
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
A Test-oriented Embedded System Production Methodology
Journal of Signal Processing Systems
Applying Evolutionary Techniques to Debug Functional Programs
IWANN '09 Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part I: Bio-Inspired Systems: Computational and Ambient Intelligence
CONCUR 2009 Proceedings of the 20th International Conference on Concurrency Theory
A prioritization approach for software test cases based on Bayesian networks
FASE'07 Proceedings of the 10th international conference on Fundamental approaches to software engineering
A systematic literature review of software quality cost research
Journal of Systems and Software
Testing of heuristic methods: a case study of greedy algorithm
CEE-SET'08 Proceedings of the Third IFIP TC 2 Central and East European conference on Software engineering techniques
Regression testing minimization, selection and prioritization: a survey
Software Testing, Verification & Reliability
Proceedings of the 2nd international workshop on Evidential assessment of software technologies
Early detection of faults related to database schematic changes
Proceedings of the 2013 International Workshop on Joining AcadeMiA and Industry Contributions to testing Automation
Test case prioritization: a systematic mapping study
Software Quality Control
Parallel execution of prioritized test cases for regression testing of web applications
ACSC '13 Proceedings of the Thirty-Sixth Australasian Computer Science Conference - Volume 135
Hi-index | 0.01 |
Test case prioritization provides a way to run test cases with the highest priority earliest. Numerous empirical studies have shown that prioritization can improve a test suite's rate of fault detection, but the extent to which these results generalize is an open question because the studies have all focused on a single procedural language, C, and a few specific types of test suites. In particular, Java and the JUnit testing framework are being used extensively to build software systems in practice, and the effectiveness of prioritization techniques on Java systems tested under JUnit has not been investigated. We have therefore designed and performed a controlled experiment examining whether test case prioritization can be effective on Java programs tested under JUnit, and comparing the results to those achieved in earlier studies. Our analyses show that test case prioritization can significantly improve the rate of fault detection of JUnit test suites, but also reveal differences with respect to previous studies that can be related to the language and testing paradigm. To investigate the practical implications of these results, we present a set of cost-benefits models for test case prioritization, and show how the effectiveness differences observed can result in savings in practice, but vary substantially with the cost factors associated with particular testing processes.