Prioritizing test cases for regression testing
Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
Permutation Generation Methods
ACM Computing Surveys (CSUR)
Prioritizing Test Cases For Regression Testing
IEEE Transactions on Software Engineering
Software Testing Techniques
Effectively prioritizing tests in development environment
ISSTA '02 Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis
The Automatic Generation of Load Test Suites and the Assessment of the Resulting Software
IEEE Transactions on Software Engineering
Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage
ICSM '01 Proceedings of the IEEE International Conference on Software Maintenance (ICSM'01)
Verification and Validation in Industry " A Qualitative Survey on the State of Practice
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
On the economics of requirements-based test case prioritization
EDSER '05 Proceedings of the seventh international workshop on Economics-driven software engineering research
Proceedings of the 2006 international workshop on Automation of software test
Software Testing Research: Achievements, Challenges, Dreams
FOSE '07 2007 Future of Software Engineering
Test Case Prioritization for Black Box Testing
COMPSAC '07 Proceedings of the 31st Annual International Computer Software and Applications Conference - Volume 01
| Hi-index | 0.01 |
The order in which tests are executed can significantly impact the total test execution time. In this paper, we evaluate two test prioritization techniques (manual and automatic) in the context of mobile phone testing. The manual technique produces test sequences created by test experts, while the automatic one generates sequences mechanically based on the permutation of the tests. Both techniques take into account a data reuse: the more the data is reused among tests, the faster the sequence is executed. In order to evaluate the benefits of these two techniques, we carried out an experiment with 8 testers and 2 test suites arranged in a 2脳2 Latin square design replicated four times. The automatic technique reduced approximately 25% of the data generation time and 13.5% of the execution time. The automatic technique is clearly better than the manual one with respect to the generation of sequences. Our experiment showed that the automatic technique also generates sequences whose execution is faster than those created manually by test experts.