The category-partition method for specifying and generating fuctional tests
Communications of the ACM
An experimental evaluation of data flow and mutation testing
Software—Practice & Experience
Analyzing Regression Test Selection Techniques
IEEE Transactions on Software Engineering
Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria
ICSE '94 Proceedings of the 16th international conference on Software engineering
All-uses vs mutation testing: an experimental comparison of effectiveness
Journal of Systems and Software
Regression testing in an industrial environment
Communications of the ACM
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
An empirical study of regression test application frequency
Proceedings of the 22nd international conference on Software engineering
Prioritizing test cases for regression testing
Proceedings of the 2000 ACM SIGSOFT international symposium on Software testing and analysis
Incorporating varying test costs and fault severities into test case prioritization
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
Prioritizing Test Cases For Regression Testing
IEEE Transactions on Software Engineering
Test Case Prioritization: A Family of Empirical Studies
IEEE Transactions on Software Engineering
Effectively prioritizing tests in development environment
ISSTA '02 Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis
Proceedings of the 24th International Conference on Software Engineering
The impact of test suite granularity on the cost-effectiveness of regression testing
Proceedings of the 24th International Conference on Software Engineering
Understanding and Measuring the Sources of Variation in the Prioritization of Regression Test Suites
METRICS '01 Proceedings of the 7th International Symposium on Software Metrics
A Study of Effective Regression Testing in Practice
ISSRE '97 Proceedings of the Eighth International Symposium on Software Reliability Engineering
Inter-Class Mutation Operators for Java
ISSRE '02 Proceedings of the 13th International Symposium on Software Reliability Engineering
A Technique for Mutation of Java Objects
Proceedings of the 16th IEEE international conference on Automated software engineering
Mutation analysis of program test data
Mutation analysis of program test data
ISSRE '03 Proceedings of the 14th International Symposium on Software Reliability Engineering
On test suite composition and cost-effective regression testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
Is mutation an appropriate tool for testing experiments?
Proceedings of the 27th international conference on Software engineering
JavaTech, an Introduction to Scientific and Technical Computing with Java
JavaTech, an Introduction to Scientific and Technical Computing with Java
Empirical Software Engineering
Prioritizing JUnit Test Cases: An Empirical Assessment and Cost-Benefits Analysis
Empirical Software Engineering
Testing Programs with the Aid of a Compiler
IEEE Transactions on Software Engineering
Automated Software Engineering
Sufficient mutation operators for measuring test effectiveness
Proceedings of the 30th international conference on Software engineering
Using sensitivity analysis to create simplified economic models for regression testing
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
A mutation model for the SystemC TLM 2.0 communication interfaces
Proceedings of the conference on Design, automation and test in Europe
An empirical study of the effect of time constraints on the cost-benefits of regression testing
Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering
Proceedings of the eighteenth international symposium on Software testing and analysis
Time-aware test-case prioritization using integer linear programming
Proceedings of the eighteenth international symposium on Software testing and analysis
Is operator-based mutant selection superior to random mutant selection?
Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1
Measuring class cohesion using mutant methods
ACM SIGSOFT Software Engineering Notes
Functional qualification of TLM verification
Proceedings of the Conference on Design, Automation and Test in Europe
On the estimation of adequate test set size using fault failure rates
Journal of Systems and Software
The use of mutation in testing experiments and its sensitivity to external threats
Proceedings of the 2011 International Symposium on Software Testing and Analysis
Fault localization for data-centric programs
Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering
How well does test case prioritization integrate with statistical fault localization?
Information and Software Technology
Accounting for defect characteristics in evaluations of testing techniques
ACM Transactions on Software Engineering and Methodology (TOSEM)
Proceedings of the 27th Annual ACM Symposium on Applied Computing
Test data regeneration: generating new test data from existing test data
Software Testing, Verification & Reliability
Regression testing minimization, selection and prioritization: a survey
Software Testing, Verification & Reliability
Proceedings of the 2012 International Symposium on Software Testing and Analysis
Software quality assurance economics
Information and Software Technology
On the Reuse of TLM Mutation Analysis at RTL
Journal of Electronic Testing: Theory and Applications
Regression test suite prioritization using system models
Software Testing, Verification & Reliability
Evaluating test suite characteristics, cost, and effectiveness of FSM-based testing methods
Information and Software Technology
Faster mutation testing inspired by test prioritization and reduction
Proceedings of the 2013 International Symposium on Software Testing and Analysis
Comparing multi-point stride coverage and dataflow coverage
Proceedings of the 2013 International Conference on Software Engineering
Bridging the gap between the total and additional test-case prioritization strategies
Proceedings of the 2013 International Conference on Software Engineering
Scaling symbolic execution using staged analysis
Innovations in Systems and Software Engineering
Mutation-oriented test data augmentation for GUI software fault localization
Information and Software Technology
System regression test planning with a fuzzy expert system
Information Sciences: an International Journal
Combining mutation and fault localization for automated program debugging
Journal of Systems and Software
An empirical study on the use of mutant traces for diagnosis of faults in deployed systems
Journal of Systems and Software
Hi-index | 0.00 |
Regression testing is an important activity in the software life cycle, but it can also be very expensive. To reduce the cost of regression testing, software testers may prioritize their test cases so that those which are more important, by some measure, are run earlier in the regression testing process. One potential goal of test case prioritization techniques is to increase a test suite's rate of fault detection (how quickly, in a run of its test cases, that test suite can detect faults). Previous work has shown that prioritization can improve a test suite's rate of fault detection, but the assessment of prioritization techniques has been limited primarily to hand-seeded faults, largely due to the belief that such faults are more realistic than automatically generated (mutation) faults. A recent empirical study, however, suggests that mutation faults can be representative of real faults and that the use of hand-seeded faults can be problematic for the validity of empirical results focusing on fault detection. We have therefore designed and performed two controlled experiments assessing the ability of prioritization techniques to improve the rate of fault detection of test case prioritization techniques, measured relative to mutation faults. Our results show that prioritization can be effective relative to the faults considered, and they expose ways in which that effectiveness can vary with characteristics of faults and test suites. More importantly, a comparison of our results with those collected using hand-seeded faults reveals several implications for researchers performing empirical studies of test case prioritization techniques in particular and testing techniques in general.