The AETG System: An Approach to Testing Based on Combinatorial Design
IEEE Transactions on Software Engineering
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
Software Metrics: A Rigorous and Practical Approach
Software Metrics: A Rigorous and Practical Approach
Testing real-time systems using genetic algorithms
Software Quality Control
In-Parameter-Order: A Test Generation Strategy for Pairwise Testing
HASE '98 The 3rd IEEE International Symposium on High-Assurance Systems Engineering
Constructing test suites for interaction testing
Proceedings of the 25th International Conference on Software Engineering
Testing the Results of Static Worst-Case Execution-Time Analysis
RTSS '98 Proceedings of the IEEE Real-Time Systems Symposium
Optimal testing-resource allocation with genetic algorithm for modular software systems
Journal of Systems and Software
Variable Strength Interaction Testing of Components
COMPSAC '03 Proceedings of the 27th Annual International Conference on Computer Software and Applications
Upper bounds for covering arrays by tabu search
Discrete Applied Mathematics - Optimal discrete structure and algorithms (ODSA 2000)
Using Artificial Life Techniques to Generate Test Cases for Combinatorial Testing
COMPSAC '04 Proceedings of the 28th Annual International Computer Software and Applications Conference - Volume 01
Experimental designs in software engineering: d-optimal designs and covering arrays
Proceedings of the 2004 ACM workshop on Interdisciplinary software engineering research
Automatic generation of high coverage usability tests
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Stress testing real-time systems with genetic algorithms
GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Improving network applications security: a new heuristic to generate stress testing data
GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
An approach for QoS-aware service composition based on genetic algorithms
GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Evolving computer intrusion scripts for vulnerability assessment and log analysis
GECCO '05 Proceedings of the 7th annual conference on Genetic and evolutionary computation
Search-based software test data generation: a survey: Research Articles
Software Testing, Verification & Reliability
Evolving Successful Stack Overflow Attacks for Vulnerability Testing
ACSAC '05 Proceedings of the 21st Annual Computer Security Applications Conference
On evolving buffer overflow attacks using genetic programming
Proceedings of the 8th annual conference on Genetic and evolutionary computation
Simulated annealing for improving software quality prediction
Proceedings of the 8th annual conference on Genetic and evolutionary computation
Improving evolutionary real-time testing
Proceedings of the 8th annual conference on Genetic and evolutionary computation
TimeAware test suite prioritization
Proceedings of the 2006 international symposium on Software testing and analysis
Using genetic algorithms for early schedulability analysis and stress testing in real-time systems
Genetic Programming and Evolvable Machines
Expert Systems with Applications: An International Journal
The Current State and Future of Search Based Software Engineering
FOSE '07 2007 Future of Software Engineering
Cross versus Within-Company Cost Estimation Studies: A Systematic Review
IEEE Transactions on Software Engineering
Finding safety errors with ACO
Proceedings of the 9th annual conference on Genetic and evolutionary computation
One-test-at-a-time heuristic search for interaction test suites
Proceedings of the 9th annual conference on Genetic and evolutionary computation
Search-based testing of service level agreements
Proceedings of the 9th annual conference on Genetic and evolutionary computation
Applying Systematic Reviews to Diverse Study Types: An Experience Report
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Detecting buffer overflow via automatic test input data generation
Computers and Operations Research
Evolutionary software engineering, a review
Applied Soft Computing
GECCO'03 Proceedings of the 2003 international conference on Genetic and evolutionary computation: PartII
Automated patching techniques: the fix is in: technical perspective
Communications of the ACM
Can we evaluate the quality of software engineering experiments?
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
Information and Software Technology
The relationship between search based software engineering and predictive modeling
Proceedings of the 6th International Conference on Predictive Models in Software Engineering
Testing in Service Oriented Architectures with dynamic binding: A mapping study
Information and Software Technology
Systematic mapping study on high-level language virtual machines
Virtual Machines and Intermediate Languages
A systematic mapping study of software product lines testing
Information and Software Technology
A study of the bi-objective next release problem
Empirical Software Engineering
Using mapping studies as the basis for further research - A participant-observer case study
Information and Software Technology
A method for evaluating rigor and industrial relevance of technology evaluations
Empirical Software Engineering
Expert Systems with Applications: An International Journal
Six years of systematic literature reviews in software engineering: An updated tertiary study
Information and Software Technology
A variable strength interaction test suites generation strategy using Particle Swarm Optimization
Journal of Systems and Software
Proceedings of the 14th international conference on Model driven engineering languages and systems
Why the virtual nature of software makes it ideal for search based optimization
FASE'10 Proceedings of the 13th international conference on Fundamental Approaches to Software Engineering
Information and Software Technology
Search based software engineering: techniques, taxonomy, tutorial
Empirical Software Engineering and Verification
Automated web application testing using search based software engineering
ASE '11 Proceedings of the 2011 26th IEEE/ACM International Conference on Automated Software Engineering
Information and Software Technology
Survey: A survey on search-based software design
Computer Science Review
Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering
Dynamic adaptive search based software engineering
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement
Search-based software engineering: Trends, techniques and applications
ACM Computing Surveys (CSUR)
A systematic review of software robustness
Information and Software Technology
Searching for pareto-optimal randomised algorithms
SSBSE'12 Proceedings of the 4th international conference on Search Based Software Engineering
A concept for an interactive search-based software testing system
SSBSE'12 Proceedings of the 4th international conference on Search Based Software Engineering
Software verification and graph similarity for automated evaluation of students' assignments
Information and Software Technology
Software engineering: an ideal set of challenges for evolutionary computation
Proceedings of the 15th annual conference companion on Genetic and evolutionary computation
An orchestrated survey of methodologies for automated software test case generation
Journal of Systems and Software
Graphical user interface (GUI) testing: Systematic mapping and repository
Information and Software Technology
Cloud engineering is Search Based Software Engineering too
Journal of Systems and Software
A systematic literature review of flexible e-procurement marketplace
Journal of Theoretical and Applied Electronic Commerce Research
Automated generation of computationally hard feature models using evolutionary algorithms
Expert Systems with Applications: An International Journal
Hi-index | 0.02 |
Search-based software testing is the application of metaheuristic search techniques to generate software tests. The test adequacy criterion is transformed into a fitness function and a set of solutions in the search space are evaluated with respect to the fitness function using a metaheuristic search technique. The application of metaheuristic search techniques for testing is promising due to the fact that exhaustive testing is infeasible considering the size and complexity of software under test. Search-based software testing has been applied across the spectrum of test case design methods; this includes white-box (structural), black-box (functional) and grey-box (combination of structural and functional) testing. In addition, metaheuristic search techniques have also been applied to test non-functional properties. The overall objective of undertaking this systematic review is to examine existing work into non-functional search-based software testing (NFSBST). We are interested in types of non-functional testing targeted using metaheuristic search techniques, different fitness functions used in different types of search-based non-functional testing and challenges in the application of these techniques. The systematic review is based on a comprehensive set of 35 articles obtained after a multi-stage selection process and have been published in the time span 1996-2007. The results of the review show that metaheuristic search techniques have been applied for non-functional testing of execution time, quality of service, security, usability and safety. A variety of metaheuristic search techniques are found to be applicable for non-functional testing including simulated annealing, tabu search, genetic algorithms, ant colony methods, grammatical evolution, genetic programming (and its variants including linear genetic programming) and swarm intelligence methods. The review reports on different fitness functions used to guide the search for each of the categories of execution time, safety, usability, quality of service and security; along with a discussion of possible challenges in the application of metaheuristic search techniques.