Theoretical comparison of testing methods
TAV3 Proceedings of the ACM SIGSOFT '89 third symposium on Software testing, analysis, and verification
Software testing techniques (2nd ed.)
Software testing techniques (2nd ed.)
Partition Testing Does Not Inspire Confidence (Program Testing)
IEEE Transactions on Software Engineering
Analyzing Partition Testing Strategies
IEEE Transactions on Software Engineering
Comparison of program testing strategies
TAV4 Proceedings of the symposium on Testing, analysis, and verification
On the Relationship Between Partition and Random Testing
IEEE Transactions on Software Engineering
Optimal Test Distributions for Software Failure Cost Estimation
IEEE Transactions on Software Engineering
Statistical testing of software based on a usage model
Software—Practice & Experience
A more general sufficient condition for partition testing to be better than random testing
Information Processing Letters
A test oracle based on formal specifications
Proceedings of the second conference on Software development tools, techniques, and alternatives
Art of Software Testing
A Formal Analysis of the Fault-Detecting Ability of Testing Methods
IEEE Transactions on Software Engineering
On some reliability estimation problems in random and partition testing
IEEE Transactions on Software Engineering
Provable Improvements on Branch Testing
IEEE Transactions on Software Engineering
Automatic Generation of Test Oracles—From Pilot Studies to Application
Automated Software Engineering
IEEE Software
Testing with hostile data streams
ACM SIGSOFT Software Engineering Notes
Comparing Partition and Random Testing via Majorization and Schur Functions
IEEE Transactions on Software Engineering
On the Statistical Properties of the F-measure
QSIC '04 Proceedings of the Quality Software, Fourth International Conference
A Case Study of Coverage-Checked Random Data Structure Testing
Proceedings of the 19th IEEE international conference on Automated software engineering
A Revisit of Adaptive Random Testing by Restriction
COMPSAC '04 Proceedings of the 28th Annual International Computer Software and Applications Conference - Volume 01
One evaluation of model-based testing and its automation
Proceedings of the 27th international conference on Software engineering
On the Test Case Definition for GUI Testing
QSIC '05 Proceedings of the Fifth International Conference on Quality Software
Tool support for randomized unit testing
Proceedings of the 1st international workshop on Random testing
Test input generation for java containers using state matching
Proceedings of the 2006 international symposium on Software testing and analysis
An empirical analysis and comparison of random testing techniques
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
On the statistical properties of testing effectiveness measures
Journal of Systems and Software - Special issue: Quality software
Adaptive software testing with fixed-memory feedback
Journal of Systems and Software
Software execution processes as an evolving complex network
Information Sciences: an International Journal
Automatic Model Generation Strategies for Model Transformation Testing
ICMT '09 Proceedings of the 2nd International Conference on Theory and Practice of Model Transformations
The axioms strike back: testing with concepts and axioms in C++
GPCE '09 Proceedings of the eighth international conference on Generative programming and component engineering
Normalized restricted random testing
Ada-Europe'03 Proceedings of the 8th Ada-Europe international conference on Reliable software technologies
Formal analysis of the effectiveness and predictability of random testing
Proceedings of the 19th international symposium on Software testing and analysis
Fault coverage of Constrained Random Test Selection for access control: A formal analysis
Journal of Systems and Software
On the danger of coverage directed test case generation
FASE'12 Proceedings of the 15th international conference on Fundamental Approaches to Software Engineering
Robust performance testing for digital forensic tools
Digital Investigation: The International Journal of Digital Forensics & Incident Response
A taxonomy of model-based testing approaches
Software Testing, Verification & Reliability
Software—Practice & Experience
Hi-index | 0.00 |
This paper compares partition testing and random testing on the assumption that program failure rates are not known with certainty before testing and are, therefore, modeled by random variables. It is shown that under uncertainty, partition testing compares more favorably to random testing than suggested by prior investigations concerning the deterministic case: The restriction to failure rates that are known with certainty systematically favors random testing. In particular, we generalize a result by Weyuker and Jeng stating equal fault detection probabilities for partition testing and random testing in the case where the failure rates in the subdomains defined by the partition are equal. It turns out that for independent random failure rates with equal expectation, the case above is a boundary case (the worst case for partition testing), and the fault detection probability of partition testing can be up to k times higher than that of random testing, where k is the number of subdomains. Also in a related model for dependent failure rates, partition testing turns out to be consistently better than random testing. The dominance can also be verified for the expected (weighted) number of detected faults as an alternative comparison criterion.