Comparing the Effectiveness of Software Testing Strategies
IEEE Transactions on Software Engineering
An experimental comparison of the effectiveness of the all-uses and all-edges adequacy criteria
TAV4 Proceedings of the symposium on Testing, analysis, and verification
PIE: A Dynamic Failure-Based Technique
IEEE Transactions on Software Engineering
An Analysis of Test Data Selection Criteria Using the RELAY Model of Fault Detection
IEEE Transactions on Software Engineering
A semantic model of program faults
ISSTA '96 Proceedings of the 1996 ACM SIGSOFT international symposium on Software testing and analysis
An experimental determination of sufficient mutant operators
ACM Transactions on Software Engineering and Methodology (TOSEM)
An approach to fault modeling and fault seeding using the program dependence graph
Journal of Systems and Software
Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria
ICSE '94 Proceedings of the 16th international conference on Software engineering
Evaluating Testing Methods by Delivered Reliability
IEEE Transactions on Software Engineering
Building Knowledge through Families of Experiments
IEEE Transactions on Software Engineering
A Critique of Software Defect Prediction Models
IEEE Transactions on Software Engineering
A controlled experiment in program testing and code walkthroughs/inspections
Communications of the ACM
An empirical study of regression test selection techniques
ACM Transactions on Software Engineering and Methodology (TOSEM)
A Formal Analysis of the Fault-Detecting Ability of Testing Methods
IEEE Transactions on Software Engineering
Assessing the applicability of fault-proneness models across object-oriented software projects
IEEE Transactions on Software Engineering
Predicting Fault Detection Effectiveness
METRICS '97 Proceedings of the 4th International Symposium on Software Metrics
Understanding and Measuring the Sources of Variation in the Prioritization of Regression Test Suites
METRICS '01 Proceedings of the 7th International Symposium on Software Metrics
Reviewing 25 Years of Testing Technique Experiments
Empirical Software Engineering
On test suite composition and cost-effective regression testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
Designing and comparing automated test oracles for GUI-based software applications
ACM Transactions on Software Engineering and Methodology (TOSEM)
Studying the Characteristics of a "Good" GUI Test Suite
ISSRE '06 Proceedings of the 17th International Symposium on Software Reliability Engineering
Using Mutation Analysis for Assessing and Comparing Testing Coverage Criteria
IEEE Transactions on Software Engineering
On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques
IEEE Transactions on Software Engineering
Using GUI Run-Time State as Feedback to Generate Test Cases
ICSE '07 Proceedings of the 29th international conference on Software Engineering
Static Analysis of Programs with Graphical User Interface
CSMR '07 Proceedings of the 11th European Conference on Software Maintenance and Reengineering
An event-flow model of GUI-based applications for testing: Research Articles
Software Testing, Verification & Reliability
Fourth international workshop on Software quality assurance: in conjunction with the 6th ESEC/FSE joint meeting
Call-Stack Coverage for GUI Test Suite Reduction
IEEE Transactions on Software Engineering
Introduction to Software Testing
Introduction to Software Testing
Relationships between Test Suites, Faults, and Fault Detection in GUI Testing
ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation
Accounting for defect characteristics in empirical studies of software testing
Accounting for defect characteristics in empirical studies of software testing
GUI Interaction Testing: Incorporating Event Context
IEEE Transactions on Software Engineering
GUI testing assisted by human knowledge: Random vs. functional
Journal of Systems and Software
Hi-index | 0.00 |
As new software-testing techniques are developed, before they can achieve widespread acceptance, their effectiveness at detecting defects must be evaluated. The most common way of evaluating testing techniques is with empirical studies, in which one or more techniques are tried out on software with known defects. However, the defects used can affect the performance of the techniques. To complicate matters, it is not even clear how to effectively describe or characterize defects. To address these problems, this article describes an experiment architecture for empirically evaluating testing techniques which takes both defect and test-suite characteristics into account. As proof of concept, an experiment on GUI-testing techniques is conducted. It provides evidence that the defect characteristics proposed do help explain defect detection, at least for GUI testing, and it explores the relationship between the coverage of defective code and the detection of defects.