The category-partition method for specifying and generating fuctional tests
Communications of the ACM
Computer Algorithms: String Pattern Matching Strategies
Computer Algorithms: String Pattern Matching Strategies
On the analysis of the (1+ 1) evolutionary algorithm
Theoretical Computer Science
Software Reliability Engineering: More Reliable Software Faster and Cheaper
Software Reliability Engineering: More Reliable Software Faster and Cheaper
Algorithmic Clustering of Music Based on String Compression
Computer Music Journal
An Industrial Investigation of Similarity Measures for Model-Based Test Case Selection
ISSRE '10 Proceedings of the 2010 IEEE 21st International Symposium on Software Reliability Engineering
Proceedings of the 33rd International Conference on Software Engineering
On the use of a similarity function for test case selection in the context of model-based testing
Software Testing, Verification & Reliability
ICST '11 Proceedings of the 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation
Industrial experiences with automated regression testing of a legacy database application
ICSM '11 Proceedings of the 2011 27th IEEE International Conference on Software Maintenance
Applying the Mahalanobis-Taguchi strategy for software defect diagnosis
Automated Software Engineering
IEEE Transactions on Information Theory
Regression testing minimization, selection and prioritization: a survey
Software Testing, Verification & Reliability
Achieving scalable model-based testing through test case diversity
ACM Transactions on Software Engineering and Methodology (TOSEM)
Hi-index | 0.00 |
Context: This paper presents an approach for selecting regression test cases in the context of large-scale database applications. We focus on a black-box (specification-based) approach, relying on classification tree models to model the input domain of the system under test (SUT), in order to obtain a more practical and scalable solution. We perform an experiment in an industrial setting where the SUT is a large database application in Norway's tax department. Objective: We investigate the use of similarity-based test case selection for supporting black box regression testing of database applications. We have developed a practical approach and tool (DART) for functional black-box regression testing of database applications. In order to make the regression test approach scalable for large database applications, we needed a test case selection strategy that reduces the test execution costs and analysis effort. We used classification tree models to partition the input domain of the SUT in order to then select test cases. Rather than selecting test cases at random from each partition, we incorporated a similarity-based test case selection, hypothesizing that it would yield a higher fault detection rate. Method: An experiment was conducted to determine which similarity-based selection algorithm was the most suitable in selecting test cases in large regression test suites, and whether similarity-based selection was a worthwhile and practical alternative to simpler solutions. Results: The results show that combining similarity measurement with partition-based test case selection, by using similarity-based test case selection within each partition, can provide improved fault detection rates over simpler solutions when specific conditions are met regarding the partitions. Conclusions: Under the conditions present in the experiment the improvements were marginal. However, a detailed analysis concludes that the similarity-based selection strategy should be applied when a large number of test cases are contained in each partition and there is significant variability within partitions. If these conditions are not present, incorporating similarity measures is not worthwhile, since the gain is negligible over a random selection within each partition.