Partition Testing Does Not Inspire Confidence (Program Testing)
IEEE Transactions on Software Engineering
Analyzing Partition Testing Strategies
IEEE Transactions on Software Engineering
On the Relationship Between Partition and Random Testing
IEEE Transactions on Software Engineering
Object-oriented software construction (2nd ed.)
Object-oriented software construction (2nd ed.)
Korat: automated testing based on Java predicates
ISSTA '02 Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis
New Quality Estimations in Random Testing
ISSRE '03 Proceedings of the 14th International Symposium on Software Reliability Engineering
JCrasher: an automatic robustness tester for Java
Software—Practice & Experience
DART: directed automated random testing
Proceedings of the 2005 ACM SIGPLAN conference on Programming language design and implementation
Proceedings of the 20th IEEE/ACM international Conference on Automated software engineering
Tool support for randomized unit testing
Proceedings of the 1st international workshop on Random testing
Object distance and its application to adaptive random testing of object-oriented programs
Proceedings of the 1st international workshop on Random testing
From daikon to agitator: lessons and challenges in building a commercial tool for developer testing
Proceedings of the 2006 international symposium on Software testing and analysis
Dynamic inference of abstract types
Proceedings of the 2006 international symposium on Software testing and analysis
ASE '06 Proceedings of the 21st IEEE/ACM International Conference on Automated Software Engineering
Reconciling Manual and Automated Testing: The AutoTest Experience
HICSS '07 Proceedings of the 40th Annual Hawaii International Conference on System Sciences
ASIAN'04 Proceedings of the 9th Asian Computing Science conference on Advances in Computer Science: dedicated to Jean-Louis Lassez on the Occasion of His 5th Cycle Birthday
Eclat: automatic generation and classification of test inputs
ECOOP'05 Proceedings of the 19th European conference on Object-Oriented Programming
ARTOO: adaptive random testing for object-oriented software
Proceedings of the 30th international conference on Software engineering
Using Dynamic Symbolic Execution to Improve Deductive Verification
SPIN '08 Proceedings of the 15th international workshop on Model Checking Software
TestFul: using a hybrid evolutionary algorithm for testing stateful systems
Proceedings of the 11th Annual conference on Genetic and evolutionary computation
Random Test Run Length and Effectiveness
ASE '08 Proceedings of the 2008 23rd IEEE/ACM International Conference on Automated Software Engineering
Evolutionary testing of object-oriented software
Proceedings of the 2010 ACM Symposium on Applied Computing
Automated fixing of programs with contracts
Proceedings of the 19th international symposium on Software testing and analysis
Generating test cases for specification mining
Proceedings of the 19th international symposium on Software testing and analysis
Verifying executable object-oriented specifications with separation logic
ECOOP'10 Proceedings of the 24th European conference on Object-oriented programming
An approach for class testing from class contracts
ATVA'10 Proceedings of the 8th international conference on Automated technology for verification and analysis
Is branch coverage a good measure of testing effectiveness?
Empirical Software Engineering and Verification
How well does test case prioritization integrate with statistical fault localization?
Information and Software Technology
An empirical study about the effectiveness of debugging when random test cases are used
Proceedings of the 34th International Conference on Software Engineering
| Hi-index | 0.02 |
Progress in testing requires that we evaluate the effectiveness of testing strategies on the basis of hard experimental evidence, not just intuition or a priori arguments. Random testing, the use of randomly generated test data, is an example of a strategy that the literature often deprecates because of such preconceptions. This view is worth revisiting since random testing otherwise offers several attractive properties: simplicity of implementation, speed of execution, absence of human bias. We performed an intensive experimental analysis of the efficiency of random testing on an existing industrial-grade code base. The use of a large-scale cluster of computers, for a total of 1500 hours of CPU time, allowed a fine-grain analysis of the individual effect of the various parameters involved in the random testing strategy, such as the choice of seed for a random number generator. The results provide insights into the effectiveness of random testing and a number of lessons for testing researchers and practitioners.