Comparing the Effectiveness of Software Testing Strategies
IEEE Transactions on Software Engineering
Software testing techniques (2nd ed.)
Software testing techniques (2nd ed.)
The AETG System: An Approach to Testing Based on Combinatorial Design
IEEE Transactions on Software Engineering
Comparing and combining software defect detection techniques: a replicated empirical study
ESEC '97/FSE-5 Proceedings of the 6th European SOFTWARE ENGINEERING conference held jointly with the 5th ACM SIGSOFT international symposium on Foundations of software engineering
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
A controlled experiment in program testing and code walkthroughs/inspections
Communications of the ACM
How to Break Software: A Practical Guide to Testing with Cdrom
How to Break Software: A Practical Guide to Testing with Cdrom
Art of Software Testing
Testing Computer Software, Second Edition
Testing Computer Software, Second Edition
Modern Information Retrieval
Lessons Learned in Software Testing
Lessons Learned in Software Testing
Systematic Software Testing
Hints for Reviewing Empirical Work in Software Engineering
Empirical Software Engineering
Managing high-speed web testing
Software quality and software testing in internet times
An Empirical Evaluation of Three Defect-Detection Techniques
Proceedings of the 5th European Software Engineering Conference
Verification and Validation in Industry " A Qualitative Survey on the State of Practice
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
Reviewing 25 Years of Testing Technique Experiments
Empirical Software Engineering
A Practitioner's Guide to Software Test Design
A Practitioner's Guide to Software Test Design
A Preliminary Survey on Software Testing Practices in Australia
ASWEC '04 Proceedings of the 2004 Australian Software Engineering Conference
Discovering Statistics Using SPSS
Discovering Statistics Using SPSS
Observations and lessons learned from automated testing
Proceedings of the 27th international conference on Software engineering
What Do We Know about Defect Detection Methods?
IEEE Software
Analysis of the influence of communication between researchers on experiment replication
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
ICSE '07 Proceedings of the 29th international conference on Software Engineering
An experimental evaluation of approaches to feature testing in the mobile phone applications domain
Workshop on Domain specific approaches to software test automation: in conjunction with the 6th ESEC/FSE joint meeting
Defect Detection Efficiency: Test Case Based vs. Exploratory Testing
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
The role of replications in empirical software engineering--a word of warning
Empirical Software Engineering
The role of replications in Empirical Software Engineering
Empirical Software Engineering
How to Test the Intangible Properties of Graphical User Interfaces?
ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation
How We Test Software at Microsoft
How We Test Software at Microsoft
Agile Testing: A Practical Guide for Testers and Agile Teams
Agile Testing: A Practical Guide for Testers and Agile Teams
The impact of process choice in high maturity environments: An empirical analysis
ICSE '09 Proceedings of the 31st International Conference on Software Engineering
Exploratory Software Testing: Tips, Tricks, Tours, and Techniques to Guide Test Design
Exploratory Software Testing: Tips, Tricks, Tours, and Techniques to Guide Test Design
How do testers do it? An exploratory study on manual testing practices
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Bridging gaps between developers and testers in globally-distributed software development
Proceedings of the FSE/SDP workshop on Future of software engineering research
Software Deployment Activities and Challenges - A Case Study of Four Software Product Companies
CSMR '11 Proceedings of the 2011 15th European Conference on Software Maintenance and Reengineering
Basics of Software Engineering Experimentation
Basics of Software Engineering Experimentation
IEEE Transactions on Software Engineering
A qualitative survey of regression testing practices
PROFES'10 Proceedings of the 11th international conference on Product-Focused Software Process Improvement
ICST '12 Proceedings of the 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation
The impact of process maturity on defect density
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement
Test overlay in an emerging software product line - An industrial case study
Information and Software Technology
More testers - The effect of crowd size and time restriction in software testing
Information and Software Technology
The Role of the Tester's Knowledge in Exploratory Software Testing
IEEE Transactions on Software Engineering
Hi-index | 0.00 |
Manual software testing is a widely practiced verification and validation method that is unlikely to fade away despite the advances in test automation. In the domain of manual testing, many practitioners advocate exploratory testing (ET), i.e., creative, experience-based testing without predesigned test cases, and they claim that it is more efficient than testing with detailed test cases. This paper reports a replicated experiment comparing effectiveness, efficiency, and perceived differences between ET and test-case-based testing (TCT) using 51 students as subjects, who performed manual functional testing on the jEdit text editor. Our results confirm the findings of the original study: 1) there is no difference in the defect detection effectiveness between ET and TCT, 2) ET is more efficient by requiring less design effort, and 3) TCT produces more false-positive defect reports than ET. Based on the small differences in the experimental design, we also put forward a hypothesis that the effectiveness of the TCT approach would suffer more than ET from time pressure. We also found that both approaches had distinctive issues: in TCT, the problems were related to correct abstraction levels of test cases, and the problems in ET were related to test design and logging of the test execution and results. Finally, we recognize that TCT has other benefits over ET in managing and controlling testing in large organizations.