Information Processing Letters
The category-partition method for specifying and generating fuctional tests
Communications of the ACM
Automatic generation of test scripts from formal test specifications
TAV3 Proceedings of the ACM SIGSOFT '89 third symposium on Software testing, analysis, and verification
A philosophy for software measurement
Journal of Systems and Software - An Oregon workshop on software metrics
PIE: A Dynamic Failure-Based Technique
IEEE Transactions on Software Engineering
Dynamic impact analysis: a cost-effective technique to enforce error-propagation
ISSTA '93 Proceedings of the 1993 ACM SIGSOFT international symposium on Software testing and analysis
An information flow model of fault detection
ISSTA '93 Proceedings of the 1993 ACM SIGSOFT international symposium on Software testing and analysis
An experimental determination of sufficient mutant operators
ACM Transactions on Software Engineering and Methodology (TOSEM)
Software metrics (2nd ed.): a rigorous and practical approach
Software metrics (2nd ed.): a rigorous and practical approach
Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria
ICSE '94 Proceedings of the 16th international conference on Software engineering
Investigating quality factors in object-oriented designs: an industrial case study
Proceedings of the 21st international conference on Software engineering
Prioritizing Test Cases For Regression Testing
IEEE Transactions on Software Engineering
Software Reliability Engineered Testing
Software Reliability Engineered Testing
Software Evolution and the Code Fault Introduction Process
Empirical Software Engineering
Case Studies for Method and Tool Evaluation
IEEE Software
The Automatic Generation of Load Test Suites and the Assessment of the Resulting Software
IEEE Transactions on Software Engineering
Empirical Evaluation of the Textual Differencing Regression Testing Technique
ICSM '98 Proceedings of the International Conference on Software Maintenance
Code Churn: A Measure for Estimating the Impact of Code Change
ICSM '98 Proceedings of the International Conference on Software Maintenance
Test Case Prioritization: An Empirical Study
ICSM '99 Proceedings of the IEEE International Conference on Software Maintenance
A Study of Effective Regression Testing in Practice
ISSRE '97 Proceedings of the Eighth International Symposium on Software Reliability Engineering
Effectively prioritizing tests in development environment
ISSTA '02 Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis
Improving web application testing with user session data
Proceedings of the 25th International Conference on Software Engineering
A Choice Relation Framework for Supporting Category-Partition Test Case Generation
IEEE Transactions on Software Engineering
Putting Your Best Tests Forward
IEEE Software
ISSTA '04 Proceedings of the 2004 ACM SIGSOFT international symposium on Software testing and analysis
Selecting a Cost-Effective Test Case Prioritization Technique
Software Quality Control
Code coverage based technique for prioritizing test cases for regression testing
ACM SIGSOFT Software Engineering Notes
Decision Support for Test Management in Iterative and Evolutionary Development
Proceedings of the 19th IEEE international conference on Automated software engineering
On test suite composition and cost-effective regression testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
Proceedings of the 27th international conference on Software engineering
Profiling Deployed Software: Assessing Strategies and Testing Opportunities
IEEE Transactions on Software Engineering
Leveraging User-Session Data to Support Web Application Testing
IEEE Transactions on Software Engineering
An extended fault class hierarchy for specification-based testing
ACM Transactions on Software Engineering and Methodology (TOSEM)
On the economics of requirements-based test case prioritization
EDSER '05 Proceedings of the seventh international workshop on Economics-driven software engineering research
Test prioritization for pairwise interaction coverage
A-MOST '05 Proceedings of the 1st international workshop on Advances in model-based testing
Checking Inside the Black Box: Regression Testing by Comparing Value Spectra
IEEE Transactions on Software Engineering
Prioritizing JUnit Test Cases: An Empirical Assessment and Cost-Benefits Analysis
Empirical Software Engineering
TimeAware test suite prioritization
Proceedings of the 2006 international symposium on Software testing and analysis
Proceedings of the 14th ACM SIGSOFT international symposium on Foundations of software engineering
Information and Software Technology
Adaptive software testing with fixed-memory feedback
Journal of Systems and Software
On the Use of Mutation Faults in Empirical Assessments of Test Case Prioritization Techniques
IEEE Transactions on Software Engineering
Compatibility and Regression Testing of COTS-Component-Based Software
ICSE '07 Proceedings of the 29th international conference on Software Engineering
Search Algorithms for Regression Test Case Prioritization
IEEE Transactions on Software Engineering
An Empirical Study of Test Case Filtering Techniques Based on Exercising Information Flows
IEEE Transactions on Software Engineering
Test suite prioritization by interaction coverage
Workshop on Domain specific approaches to software test automation: in conjunction with the 6th ESEC/FSE joint meeting
Experiments with test case prioritization using relevant slices
Journal of Systems and Software
Efficient time-aware prioritization with knapsack solvers
Proceedings of the 1st ACM international workshop on Empirical assessment of software engineering languages and technologies: held in conjunction with the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE) 2007
An experimental study of four typical test suite reduction techniques
Information and Software Technology
PHALANX: a graph-theoretic framework for test case prioritization
Proceedings of the 2008 ACM symposium on Applied computing
Incremental state-space exploration for programs with dynamically allocated data
Proceedings of the 30th international conference on Software engineering
Test case prioritization based on requirements and risk factors
ACM SIGSOFT Software Engineering Notes
Using sensitivity analysis to create simplified economic models for regression testing
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
Configuration-aware regression testing: an empirical study of sampling and prioritization
ISSTA '08 Proceedings of the 2008 international symposium on Software testing and analysis
A probabilistic alternative to regression suites
Theoretical Computer Science
Test Plan Generation for Concurrent Real-Time Systems Based on Zone Coverage Analysis
TestCom '08 / FATES '08 Proceedings of the 20th IFIP TC 6/WG 6.1 international conference on Testing of Software and Communicating Systems: 8th International Workshop
An empirical study of the effect of time constraints on the cost-benefits of regression testing
Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering
Information and Software Technology
Test case prioritization for regression testing of service-oriented business applications
Proceedings of the 18th international conference on World wide web
An empirical study of incorporating cost into test suite reduction and prioritization
Proceedings of the 2009 ACM symposium on Applied Computing
An optimized change-driven regression testing selection strategy for binary Java applications
Proceedings of the 2009 ACM symposium on Applied Computing
Misclassification cost-sensitive fault prediction models
PROMISE '09 Proceedings of the 5th International Conference on Predictor Models in Software Engineering
Proceedings of the eighteenth international symposium on Software testing and analysis
Time-aware test-case prioritization using integer linear programming
Proceedings of the eighteenth international symposium on Software testing and analysis
TAP '09 Proceedings of the 3rd International Conference on Tests and Proofs
Test input reduction for result inspection to facilitate fault localization
Automated Software Engineering
Design and analysis of GUI test-case prioritization using weight-based methods
Journal of Systems and Software
A prioritization approach for software test cases based on Bayesian networks
FASE'07 Proceedings of the 10th international conference on Fundamental approaches to software engineering
A lightweight framework for testing database applications
Proceedings of the 2010 ACM Symposium on Applied Computing
Reducing field failures in system configurable software: cost-based prioritization
ISSRE'09 Proceedings of the 20th IEEE international conference on software reliability engineering
Model-based test prioritizing: a comparative soft-computing approach and case studies
KI'09 Proceedings of the 32nd annual German conference on Advances in artificial intelligence
Empirically studying the role of selection operators duringsearch-based test suite prioritization
Proceedings of the 12th annual conference on Genetic and evolutionary computation
An effective fault aware test case prioritization by incorporating a fault localization technique
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
Clustering test cases to achieve effective test selection
Proceedings of the 1st Amrita ACM-W Celebration on Women in Computing in India
Model-based regression test case prioritization
ACM SIGSOFT Software Engineering Notes
Directed test suite augmentation: techniques and tradeoffs
Proceedings of the eighteenth ACM SIGSOFT international symposium on Foundations of software engineering
An enhanced test case selection approach for model-based testing: an industrial case study
Proceedings of the eighteenth ACM SIGSOFT international symposium on Foundations of software engineering
Reducing the cost of model-based testing through test case diversity
ICTSS'10 Proceedings of the 22nd IFIP WG 6.1 international conference on Testing software and systems
XML-manipulating test case prioritization for XML-manipulating services
Journal of Systems and Software
An empirical study on the effectiveness of time-aware test case prioritization techniques
Proceedings of the 2011 ACM Symposium on Applied Computing
Code coverage analysis in practice for large systems
Proceedings of the 33rd International Conference on Software Engineering
Directed test suite augmentation
Proceedings of the 33rd International Conference on Software Engineering
Optimizing cost and quality by integrating inspection and test processes
Proceedings of the 2011 International Conference on Software and Systems Process
An algorithm for capturing variables dependences in test suites
Journal of Systems and Software
Source code prioritization using forward slicing for exposing critical elements in a program
Journal of Computer Science and Technology
Towards incremental component compatibility testing
Proceedings of the 14th international ACM Sigsoft symposium on Component based software engineering
Change-aware preemption prioritization
Proceedings of the 2011 International Symposium on Software Testing and Analysis
Fault-based test suite prioritization for specification-based testing
Information and Software Technology
Coverage-Based, prioritized testing using neural network clustering
ISCIS'06 Proceedings of the 21st international conference on Computer and Information Sciences
Using test cases as contract to ensure service compliance across releases
ICSOC'05 Proceedings of the Third international conference on Service-Oriented Computing
Prioritizing test cases with string distances
Automated Software Engineering
Reliability improvement based on prioritization of source code
ICDCIT'10 Proceedings of the 6th international conference on Distributed Computing and Internet Technology
Automated test scenario selection based on levenshtein distance
ICDCIT'10 Proceedings of the 6th international conference on Distributed Computing and Internet Technology
Test case filtering and prioritization based on coverage of combinations of program elements
WODA '09 Proceedings of the Seventh International Workshop on Dynamic Analysis
A history-based cost-cognizant test case prioritization technique in regression testing
Journal of Systems and Software
Controversy Corner: Improving test efficiency through system test prioritization
Journal of Systems and Software
CBSE'06 Proceedings of the 9th international conference on Component-Based Software Engineering
Journal of Systems and Software
Prioritizing tests for fault localization through ambiguity group reduction
ASE '11 Proceedings of the 2011 26th IEEE/ACM International Conference on Automated Software Engineering
Information and Software Technology
How well does test case prioritization integrate with statistical fault localization?
Information and Software Technology
A quality checklist for technology-centred testing studies
EASE'09 Proceedings of the 13th international conference on Evaluation and Assessment in Software Engineering
Regression testing minimization, selection and prioritization: a survey
Software Testing, Verification & Reliability
Evolutionary algorithm for prioritized pairwise test data generation
Proceedings of the 14th annual conference on Genetic and evolutionary computation
Active refinement of clone anomaly reports
Proceedings of the 34th International Conference on Software Engineering
An empirical evaluation of several test-a-few strategies for testing particular conditions
Software—Practice & Experience
Diversity maximization speedup for fault localization
Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering
An improved method for test case prioritization by incorporating historical test case data
Science of Computer Programming
Regression test suite prioritization using system models
Software Testing, Verification & Reliability
CarFast: achieving higher statement coverage faster
Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering
Coverage-oriented, prioritized testing: a fuzzy clustering approach and case study
LADC'07 Proceedings of the Third Latin-American conference on Dependable Computing
Testing component compatibility in evolving configurations
Information and Software Technology
Code-based prioritization: a pre-testing effort to minimize post-release failures
Innovations in Systems and Software Engineering
Achieving scalable model-based testing through test case diversity
ACM Transactions on Software Engineering and Methodology (TOSEM)
Information and Software Technology
Linking software testing results with a machine learning approach
Engineering Applications of Artificial Intelligence
Multi-objective test case prioritization for GUI applications
Proceedings of the 28th Annual ACM Symposium on Applied Computing
Faster mutation testing inspired by test prioritization and reduction
Proceedings of the 2013 International Symposium on Software Testing and Analysis
Improving scenario testing process by adding value-based prioritization: an industrial case study
Proceedings of the 2013 International Conference on Software and System Process
Bridging the gap between the total and additional test-case prioritization strategies
Proceedings of the 2013 International Conference on Software Engineering
Continuous test suite augmentation in software product lines
Proceedings of the 17th International Software Product Line Conference
Is this a bug or an obsolete test?
ECOOP'13 Proceedings of the 27th European conference on Object-Oriented Programming
Parallel execution of prioritized test cases for regression testing of web applications
ACSC '13 Proceedings of the Thirty-Sixth Australasian Computer Science Conference - Volume 135
Test Pair Selection for Test Case Prioritization in Regression Testing for WS-BPEL Programs
International Journal of Web Services Research
System regression test planning with a fuzzy expert system
Information Sciences: an International Journal
Static test case prioritization using topic models
Empirical Software Engineering
Combining mutation and fault localization for automated program debugging
Journal of Systems and Software
Hi-index | 0.00 |
To reduce the cost of regression testing, software testers may prioritize their test cases so that those which are more important, by some measure, are run earlier in the regression testing process. One potential goal of such prioritization is to increase a test suite's rate of fault detection. Previous work reported results of studies that showed that prioritization techniques can significantly improve rate of fault detection. Those studies, however, raised several additional questions: 1) Can prioritization techniques be effective when targeted at specific modified versions; 2) what trade-offs exist between fine granularity and coarse granularity prioritization techniques; 3) can the incorporation of measures of fault proneness into prioritization techniques improve their effectiveness? To address these questions, we have performed several new studies in which we empirically compared prioritization techniques using both controlled experiments and case studies. The results of these studies show that each of the prioritization techniques considered can improve the rate of fault detection of test suites overall. Fine-granularity techniques typically outperformed coarse-granularity techniques, but only by a relatively small margin overall; in other words, the relative imprecision in coarse-granularity analysis did not dramatically reduce coarse-granularity techniques' ability to improve rate of fault detection. Incorporation of fault-proneness techniques produced relatively small improvements over other techniques in terms of rate of fault detection, a result which ran contrary to our expectations. Our studies also show that the relative effectiveness of various techniques can vary significantly across target programs. Furthermore, our analysis shows that whether the effectiveness differences observed will result in savings in practice varies substantially with the cost factors associated with particular testing processes. Further work to understand the sources of this variance and to incorporate such understanding into prioritization techniques and the choice of techniques would be beneficial.