Automated metamorphic testing on the analyses of feature models
Information and Software Technology
Testing and validating machine learning classifiers by metamorphic testing
Journal of Systems and Software
Testing a binary space partitioning algorithm with metamorphic testing
Proceedings of the 2011 ACM Symposium on Applied Computing
Evolutionary search-based test generation for software product line feature models
CAiSE'12 Proceedings of the 24th international conference on Advanced Information Systems Engineering
Evaluating Different Strategies for Testing Software Product Lines
Journal of Electronic Testing: Theory and Applications
Improving product configuration in software product line engineering
ACSC '13 Proceedings of the Thirty-Sixth Australasian Computer Science Conference - Volume 135
| Hi-index | 0.00 |
A Feature Model (FM) is a compact representation of all the products of a software product line. The automated extraction of information from FMs is a thriving research topic involving a number of analysis operations, algorithms, paradigms and tools. Implementing these operations is far from trivial and easily leads to errors and defects in analysis solutions. Current testing methods in this context mainly rely on the ability of the tester to decide whether the output of an analysis is correct. However, this is acknowledged to be time-consuming, error-prone and in most cases infeasible due to the combinatorial complexity of the analyses. In this paper, we present a set of relations (so-called metamorphic relations) between input FMs and their set of products and a test data generator relying on them. Given an FM and its known set of products, a set of neighbour FMs together with their corresponding set of products are automatically generated and used for testing different analyses. Complex FMs representing millions of products can be efficiently created applying this process iteratively. The evaluation of our approach using mutation testing as well as real faults and tools reveals that most faults can be automatically detected within a few seconds.