Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria
ICSE '94 Proceedings of the 16th international conference on Software engineering
Empirical Studies of a Safe Regression Test Selection Technique
IEEE Transactions on Software Engineering
Patterns in property specifications for finite-state verification
Proceedings of the 21st international conference on Software engineering
Coverage estimation for symbolic model checking
Proceedings of the 36th annual ACM/IEEE Design Automation Conference
Empirical research in software engineering: a workshop
ACM SIGSOFT Software Engineering Notes
Dynamically Discovering Likely Program Invariants to Support Program Evolution
IEEE Transactions on Software Engineering - Special issue on 1999 international conference on software engineering
The SLAM project: debugging system software via static analysis
POPL '02 Proceedings of the 29th ACM SIGPLAN-SIGACT symposium on Principles of programming languages
Assertions: A Personal Perspective
IEEE Annals of the History of Computing
Bogor: an extensible and highly-modular software model checking framework
Proceedings of the 9th European software engineering conference held jointly with 11th ACM SIGSOFT international symposium on Foundations of software engineering
Dynamically inferring temporal properties
Proceedings of the 5th ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering
ICSM '04 Proceedings of the 20th IEEE International Conference on Software Maintenance
Towards building a solid empirical body of knowledge in testing techniques
ACM SIGSOFT Software Engineering Notes
Generating Efficient Test Sets with a Model Checker
SEFM '04 Proceedings of the Software Engineering and Formal Methods, Second International Conference
Is mutation an appropriate tool for testing experiments?
Proceedings of the 27th international conference on Software engineering
Using source transformation to test and model check implicit-invocation systems
Science of Computer Programming - Special issue on source code analysis and manipulation (SCAM 2005)
WoSQ '07 Proceedings of the 5th International Workshop on Software Quality
Model-Based Quality Assurance of Automotive Software
MoDELS '08 Proceedings of the 11th international conference on Model Driven Engineering Languages and Systems
An experimental assessment of module documentation-based testing
Information and Software Technology
The use of mutation in testing experiments and its sensitivity to external threats
Proceedings of the 2011 International Symposium on Software Testing and Analysis
Hi-index | 0.00 |
Today, many formal analysis tools are not only used to provide certainty but are also used to debug software systems - a role that has traditional been reserved for testing tools. We are interested in exploring the complementary relationship as well as tradeoffs between testing and formal analysis with respect to debugging and more specifically bug detection. In this paper we present an approach to the assessment of testing and formal analysis tools using metrics to measure the quantity and efficiency of each technique at finding bugs. We also present an assessment framework that has been constructed to allow for symmetrical comparison and evaluation of tests versus properties. We are currently beginning to conduct experiments and this paper presents a discussion of possible outcomes of our proposed empirical study.