The AETG System: An Approach to Testing Based on Combinatorial Design
IEEE Transactions on Software Engineering
The Feature and Service Interaction Problem in Telecommunications Systems: A Survey
IEEE Transactions on Software Engineering
Managing a Network Vulnerability Assessment
Managing a Network Vulnerability Assessment
A Test Generation Strategy for Pairwise Testing
IEEE Transactions on Software Engineering
Software Fault Interactions and Implications for Software Testing
IEEE Transactions on Software Engineering
MuJava: an automated class mutation system: Research Articles
Software Testing, Verification & Reliability
Roux-type constructions for covering arrays of strengths three and four
Designs, Codes and Cryptography
IPOG: A General Strategy for T-Way Software Testing
ECBS '07 Proceedings of the 14th Annual IEEE International Conference and Workshops on the Engineering of Computer-Based Systems
Graph Theory
A density-based greedy algorithm for higher strength covering arrays
Software Testing, Verification & Reliability
Locating Errors Using ELAs, Covering Arrays, and Adaptive Testing Algorithms
SIAM Journal on Discrete Mathematics
Hi-index | 0.00 |
With pairwise testing, the test model is a list of N parameters. Each test case is an N-tuple; the test space is the cross product of the N parameters. A pairwise test is a set of N-tuples where every pairwise combination of the parameter values is contained in at least one of the N-tuples. Well-known algorithms generate pairwise test sets far smaller than the test space. Pairwise testing has good tool support and is widely known in industry and academia. Empirical results have shown the effectiveness of the approach. While pairwise testing is used to generate test inputs, we propose a novel analysis of the test outputs. We focus on bad pairs: those which always result in a failed test case. We experimentally evaluate the frequency of occurrence of bad pairs using mutation testing with 1 and 2 faults per mutant. The results provide useful insights into two important relationships: (1) between faults and bad pairs and (2) between input selection and bad pairs. We then apply the approach to an industrial example in network vulnerability testing. We also present error-locating arrays, a recent theoretical result providing a powerful tool for bad pairs analysis.