Design patterns: elements of reusable object-oriented software
Design patterns: elements of reusable object-oriented software
Algorithms on strings, trees, and sequences: computer science and computational biology
Algorithms on strings, trees, and sequences: computer science and computational biology
Practical genetic algorithms
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
Testing object-oriented systems: models, patterns, and tools
Testing object-oriented systems: models, patterns, and tools
Introduction to algorithms
Test Case Prioritization: A Family of Empirical Studies
IEEE Transactions on Software Engineering
On the analysis of the (1+ 1) evolutionary algorithm
Theoretical Computer Science
Test-Suite Reduction and Prioritization for Modified Condition/Decision Coverage
IEEE Transactions on Software Engineering
UML Bible
ISSRE '03 Proceedings of the 14th International Symposium on Software Reliability Engineering
Workshop on advances in model-based software testing
Proceedings of the 27th international conference on Software engineering
Introduction to Data Mining, (First Edition)
Introduction to Data Mining, (First Edition)
COMPSAC '06 Proceedings of the 30th Annual International Computer Software and Applications Conference - Volume 02
Practical Model-Based Testing: A Tools Approach
Practical Model-Based Testing: A Tools Approach
Empirical Software Engineering
The Current State and Future of Search Based Software Engineering
FOSE '07 2007 Future of Software Engineering
Using component metadata to regression test component-based software: Research Articles
Software Testing, Verification & Reliability
Search Algorithms for Regression Test Case Prioritization
IEEE Transactions on Software Engineering
An Empirical Study of Test Case Filtering Techniques Based on Exercising Information Flows
IEEE Transactions on Software Engineering
A multi-objective approach to search-based test data generation
Proceedings of the 9th annual conference on Genetic and evolutionary computation
Model-based test prioritization heuristic methods and their evaluation
Proceedings of the 3rd international workshop on Advances in model-based testing
Evolutionary algorithms for constrained parameter optimization problems
Evolutionary Computation
Call-Stack Coverage for GUI Test Suite Reduction
IEEE Transactions on Software Engineering
PHALANX: a graph-theoretic framework for test case prioritization
Proceedings of the 2008 ACM symposium on Applied computing
Search based software testing of object-oriented containers
Information Sciences: an International Journal
Introduction to Information Retrieval
Introduction to Information Retrieval
Searching for Cognitively Diverse Tests: Towards Universal Test Diversity Metrics
ICSTW '08 Proceedings of the 2008 IEEE International Conference on Software Testing Verification and Validation Workshop
Proceedings of the eighteenth international symposium on Software testing and analysis
Adaptive Random Testing: The ART of test case diversity
Journal of Systems and Software
Regression test suite reduction based on SDL models of system requirements
Journal of Software Maintenance and Evolution: Research and Practice
Adaptive Random Test Case Prioritization
ASE '09 Proceedings of the 2009 IEEE/ACM International Conference on Automated Software Engineering
Using String Distances for Test Case Prioritisation
ASE '09 Proceedings of the 2009 IEEE/ACM International Conference on Automated Software Engineering
Data clustering: 50 years beyond K-means
Pattern Recognition Letters
A Theoretical and Empirical Study of Search-Based Testing: Local, Global, and Hybrid Search
IEEE Transactions on Software Engineering
Foundations of Software Testing
Foundations of Software Testing
Longer is Better: On the Role of Test Sequence Length in Software Testing
ICST '10 Proceedings of the 2010 Third International Conference on Software Testing, Verification and Validation
An enhanced test case selection approach for model-based testing: an industrial case study
Proceedings of the eighteenth ACM SIGSOFT international symposium on Foundations of software engineering
An Industrial Investigation of Similarity Measures for Model-Based Test Case Selection
ISSRE '10 Proceedings of the 2010 IEEE 21st International Symposium on Software Reliability Engineering
IEEE Transactions on Software Engineering
Reducing the cost of model-based testing through test case diversity
ICTSS'10 Proceedings of the 22nd IFIP WG 6.1 international conference on Testing software and systems
Proceedings of the 33rd International Conference on Software Engineering
On the use of a similarity function for test case selection in the context of model-based testing
Software Testing, Verification & Reliability
ICST '11 Proceedings of the 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation
Test suite reduction based on dependence analysis
ISCIS'06 Proceedings of the 21st international conference on Computer and Information Sciences
Test-Suite reduction using genetic algorithm
APPT'05 Proceedings of the 6th international conference on Advanced Parallel Processing Technologies
No free lunch theorems for optimization
IEEE Transactions on Evolutionary Computation
Survey of clustering algorithms
IEEE Transactions on Neural Networks
Test data variance as a test quality measure: exemplified for TTCN-3
TestCom'07/FATES'07 Proceedings of the 19th IFIP TC6/WG6.1 international conference, and 7th international conference on Testing of Software and Communicating Systems
Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering
Test case selection for black-box regression testing of database applications
Information and Software Technology
Static test case prioritization using topic models
Empirical Software Engineering
Hi-index | 0.00 |
The increase in size and complexity of modern software systems requires scalable, systematic, and automated testing approaches. Model-based testing (MBT), as a systematic and automated test case generation technique, is being successfully applied to verify industrial-scale systems and is supported by commercial tools. However, scalability is still an open issue for large systems, as in practice there are limits to the amount of testing that can be performed in industrial contexts. Even with standard coverage criteria, the resulting test suites generated by MBT techniques can be very large and expensive to execute, especially for system level testing on real deployment platforms and network facilities. Therefore, a scalable MBT technique should be flexible regarding the size of the generated test suites and should be easily accommodated to fit resource and time constraints. Our approach is to select a subset of the generated test suite in such a way that it can be realistically executed and analyzed within the time and resource constraints, while preserving the fault revealing power of the original test suite to a maximum extent. In this article, to address this problem, we introduce a family of similarity-based test case selection techniques for test suites generated from state machines. We evaluate 320 different similarity-based selection techniques and then compare the effectiveness of the best similarity-based selection technique with other common selection techniques in the literature. The results based on two industrial case studies, in the domain of embedded systems, show significant benefits and a large improvement in performance when using a similarity-based approach. We complement these analyses with further studies on the scalability of the technique and the effects of failure rate on its effectiveness. We also propose a method to identify optimal tradeoffs between the number of test cases to run and fault detection.