Investigations of the software testing coupling effect
ACM Transactions on Software Engineering and Methodology (TOSEM)
A Markov Chain Model for Statistical Software Testing
IEEE Transactions on Software Engineering
Distinguishing tests for nondeterministic and probabilistic machines
STOC '95 Proceedings of the twenty-seventh annual ACM symposium on Theory of computing
Fault models for testing in context
IFIP TC6/ 6.1 international conference on formal description techniques IX/protocol specification, testing and verification XVI on Formal description techniques IX : theory, application and tools: theory, application and tools
Petri Net Theory and the Modeling of Systems
Petri Net Theory and the Modeling of Systems
IEEE Transactions on Software Engineering
An Empirical Evaluation of Weak Mutation
IEEE Transactions on Software Engineering
Fault Model-Driven Test Derivation from Finite State Models: Annotated Bibliography
MOVEP '00 Proceedings of the 4th Summer School on Modeling and Verification of Parallel Processes
A Formal Approach to Conformance Testing
Proceedings of the IFIP TC6/WG6.1 Sixth International Workshop on Protocol Test systems VI
Specification Coverage Aided Test Selection
ACSD '03 Proceedings of the Third International Conference on Application of Concurrency to System Design
Testing transition systems with input and output testers
TestCom'03 Proceedings of the 15th IFIP international conference on Testing of communicating systems
Experiences in using b and UML in industrial development
B'07 Proceedings of the 7th international conference on Formal Specification and Development in B
| Hi-index | 0.00 |
Testing should not reduce confidence in the system under test – unless defects are found. We show that for a general class of finite-state systems this intuition is incorrect. We base our argument on the view of risk as a probability. We calculate the risk of having an invalid implementation, based on a concrete, believable fault model, and show that executing correct test runs can actually decrease confidence in the system under test. This anomaly is important as it explains some of the difficulty in establishing mathematical links between fault models and testing efficiency. The presented anomaly itself is claimed to be independent of the particular structure of systems. We provide critique of the result, and discuss the potential limits of the presented anomaly as well as ways to remedy it.