Experiments of the effectiveness of dataflow- and controlflow-based test adequacy criteria
ICSE '94 Proceedings of the 16th international conference on Software engineering
The algorithm design manual
Incorporating varying test costs and fault severities into test case prioritization
ICSE '01 Proceedings of the 23rd International Conference on Software Engineering
Prioritizing Test Cases For Regression Testing
IEEE Transactions on Software Engineering
Test Case Prioritization: A Family of Empirical Studies
IEEE Transactions on Software Engineering
Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control and Artificial Intelligence
Effectively prioritizing tests in development environment
ISSTA '02 Proceedings of the 2002 ACM SIGSOFT international symposium on Software testing and analysis
Computers and Intractability: A Guide to the Theory of NP-Completeness
Computers and Intractability: A Guide to the Theory of NP-Completeness
Proceedings of the 24th International Conference on Software Engineering
Adaptive Selection Methods for Genetic Algorithms
Proceedings of the 1st International Conference on Genetic Algorithms
Test Case Prioritization: An Empirical Study
ICSM '99 Proceedings of the IEEE International Conference on Software Maintenance
A Study of Effective Regression Testing in Practice
ISSRE '97 Proceedings of the Eighth International Symposium on Software Reliability Engineering
Empirical Software Engineering
ICSM '05 Proceedings of the 21st IEEE International Conference on Software Maintenance
The Current State and Future of Search Based Software Engineering
FOSE '07 2007 Future of Software Engineering
Automated Test Data Generation using Search Based Software Engineering
AST '07 Proceedings of the Second International Workshop on Automation of Software Test
Pareto efficient multi-objective test case selection
Proceedings of the 2007 international symposium on Software testing and analysis
Pareto optimal search based refactoring at the design level
Proceedings of the 9th annual conference on Genetic and evolutionary computation
Model-based test prioritization heuristic methods and their evaluation
Proceedings of the 3rd international workshop on Advances in model-based testing
Test suite reduction and prioritization with call trees
Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering
Using coverage effectiveness to evaluate test suite prioritizations
Proceedings of the 1st ACM international workshop on Empirical assessment of software engineering languages and technologies: held in conjunction with the 22nd IEEE/ACM International Conference on Automated Software Engineering (ASE) 2007
An experimental study of four typical test suite reduction techniques
Information and Software Technology
Incremental state-space exploration for programs with dynamically allocated data
Proceedings of the 30th international conference on Software engineering
Locating dependence structures using search-based slicing
Information and Software Technology
PROPOR '08 Proceedings of the 8th international conference on Computational Processing of the Portuguese Language
An empirical study of the effect of time constraints on the cost-benefits of regression testing
Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering
Analysis of test suite reduction with enhanced tie-breaking techniques
Information and Software Technology
Automated test data generation using a scatter search approach
Information and Software Technology
Information and Software Technology
Test case prioritization for regression testing of service-oriented business applications
Proceedings of the 18th international conference on World wide web
An empirical study of incorporating cost into test suite reduction and prioritization
Proceedings of the 2009 ACM symposium on Applied Computing
An optimized change-driven regression testing selection strategy for binary Java applications
Proceedings of the 2009 ACM symposium on Applied Computing
A model-based regression test selection approach for embedded applications
ACM SIGSOFT Software Engineering Notes
An empirical study of the factors that reduce the effectiveness of coverage-based fault localization
Proceedings of the 2nd International Workshop on Defects in Large Software Systems: Held in conjunction with the ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA 2009)
A hybrid heuristic approach to optimize rule-based software quality estimation models
Information and Software Technology
Search-based failure discovery using testability transformations to generate pseudo-oracles
Proceedings of the 11th Annual conference on Genetic and evolutionary computation
Proceedings of the eighteenth international symposium on Software testing and analysis
Time-aware test-case prioritization using integer linear programming
Proceedings of the eighteenth international symposium on Software testing and analysis
Regression testing with UML software designs: A survey
Journal of Software Maintenance and Evolution: Research and Practice
TAP '09 Proceedings of the 3rd International Conference on Tests and Proofs
Intrusion detection using signatures extracted from execution profiles
IWSESS '09 Proceedings of the 2009 ICSE Workshop on Software Engineering for Secure Systems
Using hybrid algorithm for Pareto efficient multi-objective test suite minimisation
Journal of Systems and Software
Is operator-based mutant selection superior to random mutant selection?
Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 1
Designing better fitness functions for automated program repair
Proceedings of the 12th annual conference on Genetic and evolutionary computation
Factors affecting the use of genetic algorithms in test suite augmentation
Proceedings of the 12th annual conference on Genetic and evolutionary computation
Empirically studying the role of selection operators duringsearch-based test suite prioritization
Proceedings of the 12th annual conference on Genetic and evolutionary computation
Using synthetic test suites to empirically compare search-based and greedy prioritizers
Proceedings of the 12th annual conference companion on Genetic and evolutionary computation
A platform for search-based testing of concurrent software
Proceedings of the 8th Workshop on Parallel and Distributed Systems: Testing, Analysis, and Debugging
The relationship between search based software engineering and predictive modeling
Proceedings of the 6th International Conference on Predictive Models in Software Engineering
An empirical investigation into branch coverage for C programs using CUTE and AUSTIN
Journal of Systems and Software
Directed test suite augmentation: techniques and tradeoffs
Proceedings of the eighteenth ACM SIGSOFT international symposium on Foundations of software engineering
An enhanced test case selection approach for model-based testing: an industrial case study
Proceedings of the eighteenth ACM SIGSOFT international symposium on Foundations of software engineering
A survey of combinatorial testing
ACM Computing Surveys (CSUR)
Reducing the cost of model-based testing through test case diversity
ICTSS'10 Proceedings of the 22nd IFIP WG 6.1 international conference on Testing software and systems
XML-manipulating test case prioritization for XML-manipulating services
Journal of Systems and Software
Information and Software Technology
Automated test case prioritization with reactive GRASP
Advances in Software Engineering - Special issue on software test automation
Evaluating improvements to a meta-heuristic search for constrained interaction testing
Empirical Software Engineering
An empirical study on the effectiveness of time-aware test case prioritization techniques
Proceedings of the 2011 ACM Symposium on Applied Computing
Adaptive random testing: an illusion of effectiveness?
Proceedings of the 2011 International Symposium on Software Testing and Analysis
A diagnostic reasoning approach to defect prediction
IEA/AIE'11 Proceedings of the 24th international conference on Industrial engineering and other applications of applied intelligent systems conference on Modern approaches in applied intelligence - Volume Part II
Ten years of search based software engineering: a bibliometric analysis
SSBSE'11 Proceedings of the Third international conference on Search based software engineering
Prioritizing test cases with string distances
Automated Software Engineering
Test case filtering and prioritization based on coverage of combinations of program elements
WODA '09 Proceedings of the Seventh International Workshop on Dynamic Analysis
A history-based cost-cognizant test case prioritization technique in regression testing
Journal of Systems and Software
Search-based fault localization
ASE '11 Proceedings of the 2011 26th IEEE/ACM International Conference on Automated Software Engineering
Prioritizing tests for fault localization through ambiguity group reduction
ASE '11 Proceedings of the 2011 26th IEEE/ACM International Conference on Automated Software Engineering
How well does test case prioritization integrate with statistical fault localization?
Information and Software Technology
Regression testing minimization, selection and prioritization: a survey
Software Testing, Verification & Reliability
iTree: efficiently discovering high-coverage configurations using interaction trees
Proceedings of the 34th International Conference on Software Engineering
Software quality assurance economics
Information and Software Technology
Diversity maximization speedup for fault localization
Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering
High-coverage symbolic patch testing
SPIN'12 Proceedings of the 19th international conference on Model Checking Software
Proceedings of the 2nd international workshop on Evidential assessment of software technologies
An improved method for test case prioritization by incorporating historical test case data
Science of Computer Programming
Achieving scalable model-based testing through test case diversity
ACM Transactions on Software Engineering and Methodology (TOSEM)
Information and Software Technology
Bridging the gap between the total and additional test-case prioritization strategies
Proceedings of the 2013 International Conference on Software Engineering
Diversity in software engineering research
Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering
Improving trace accuracy through data-driven configuration and composition of tracing features
Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering
Fault localization prioritization: Comparing information-theoretic and coverage-based approaches
ACM Transactions on Software Engineering and Methodology (TOSEM) - In memoriam, fault detection and localization, formal methods, modeling and design
Continuous test suite augmentation in software product lines
Proceedings of the 17th International Software Product Line Conference
Refinement-based testing of delta-oriented product lines
Proceedings of the 2013 International Conference on Principles and Practices of Programming on the Java Platform: Virtual Machines, Languages, and Tools
Test Pair Selection for Test Case Prioritization in Regression Testing for WS-BPEL Programs
International Journal of Web Services Research
Exploration and analysis of regression test suite optimization
ACM SIGSOFT Software Engineering Notes
Generating profile-based signatures for online intrusion and failure detection
Information and Software Technology
Automatic generation of basis test paths using variable length genetic algorithm
Information Processing Letters
Hi-index | 0.00 |
Regression testing is an expensive, but important, process. Unfortunately, there may be insufficient resources to allow for the reexecution of all test cases during regression testing. In this situation, test case prioritization techniques aim to improve the effectiveness of regression testing by ordering the test cases so that the most beneficial are executed first. Previous work on regression test case prioritization has focused on Greedy Algorithms. However, it is known that these algorithms may produce suboptimal results because they may construct results that denote only local minima within the search space. By contrast, metaheuristic and evolutionary search algorithms aim to avoid such problems. This paper presents results from an empirical study of the application of several greedy, metaheuristic, and evolutionary search algorithms to six programs, ranging from 374 to 11,148 lines of code for three choices of fitness metric. The paper addresses the problems of choice of fitness metric, characterization of landscape modality, and determination of the most suitable search technique to apply. The empirical results replicate previous results concerning Greedy Algorithms. They shed light on the nature of the regression testing search space, indicating that it is multimodal. The results also show that Genetic Algorithms perform well, although Greedy approaches are surprisingly effective, given the multimodal nature of the landscape.