Orthogonal Latin squares: an application of experiment design to compiler testing
Communications of the ACM
The category-partition method for specifying and generating fuctional tests
Communications of the ACM
The AETG System: An Approach to Testing Based on Combinatorial Design
IEEE Transactions on Software Engineering
Automated test-data generation for exception conditions
Software—Practice & Experience
Black-box test reduction using input-output analysis
Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
Test Case Prioritization: A Family of Empirical Studies
IEEE Transactions on Software Engineering
A Test Generation Strategy for Pairwise Testing
IEEE Transactions on Software Engineering
A Choice Relation Framework for Supporting Category-Partition Test Case Generation
IEEE Transactions on Software Engineering
Generating, Selecting and Prioritizing Test Cases from Specifications with Tool Support
QSIC '03 Proceedings of the Third International Conference on Quality Software
The Art of Software Testing
On the Testing of Particular Input Conditions
COMPSAC '04 Proceedings of the 28th Annual International Computer Software and Applications Conference - Volume 01
An approach to automatic testing exception handling
ACM SIGPLAN Notices
Efficient path conditions in dependence graphs for software safety analysis
ACM Transactions on Software Engineering and Methodology (TOSEM)
Slicing as a program transformation
ACM Transactions on Programming Languages and Systems (TOPLAS)
A combinatorial testing strategy for concurrent programs
Software Testing, Verification & Reliability
IPOG-IPOG-D: efficient test generation for multi-way combinatorial testing
Software Testing, Verification & Reliability
Conditioned semantic slicing for abstraction; industrial experiment
Software—Practice & Experience
Covering code behavior on input validation in functional testing
Information and Software Technology
Analysis of test suite reduction with enhanced tie-breaking techniques
Information and Software Technology
An Evaluation of Specification Based Test Generation Techniques Using Model Checkers
TAIC-PART '09 Proceedings of the 2009 Testing: Academic and Industrial Conference - Practice and Research Techniques
On the use of a similarity function for test case selection in the context of model-based testing
Software Testing, Verification & Reliability
Software—Practice & Experience
Automated verification and testing of user-interactive undo features in database applications
Software Testing, Verification & Reliability
Choices, choices: comparing between CHOC'LATE and the classification-tree methodology
Ada-Europe'12 Proceedings of the 17th Ada-Europe international conference on Reliable Software Technologies
Hi-index | 0.00 |
Existing specification-based testing techniques often generate comprehensive test suites to cover diverse combinations of test-relevant aspects. Such a test suite can be prohibitively expensive to execute exhaustively because of its large size. A pragmatic strategy often adopted in practice, called test-once strategy, is to identify certain particular conditions from the specification and to test each such condition once only. This strategy is implicitly based on the uniformity assumption that the implementation will process a particular condition uniformly, regardless of other parameters or inputs. As the decision of adopting the test-once strategy is often based on the specification, whether the uniformity assumption actually holds in the implementation needs to be critically assessed, or else the risk of inadequate testing could be non-negligible. As viable alternatives to reduce such a risk, a family of test-a-few strategies for the testing of particular conditions is proposed in this paper. Two rounds of experiments that evaluate the effectiveness of the test-a-few strategies as compared with the test-once strategy are further reported. Our experiments do the following: (1) provide clear evidence that the uniformity assumption often, but not always, holds and that the assumption usually fails to hold when the implementation is faulty; (2) demonstrate that all our proposed test-a-few strategies are statistically more reliable than the test-once strategy in revealing faulty programs; (3) show that random sampling is already substantially more effective than the test-once strategy; and (4) indicate that, compared with other test-a-few strategies under study, choice coverage seems to achieve a better trade-off between test effort and effectiveness. Copyright © 2011 John Wiley & Sons, Ltd.