Metamorphic testing of a Monte Carlo modeling program
Proceedings of the 6th International Workshop on Automation of Software Test
Automated generation of test oracles using a model-driven approach
Information and Software Technology
| Hi-index | 0.00 |
Full software test automation requires automated test input generation, execution, and output evaluation. The latter task is non-trivial and usually referred to as the oracle problem in software testing. The present paper describes an empirical study on Metamorphic Testing, an approach to the oracle problem. This study was conducted with common Java implementations of determinant computation in order to evaluate the usefulness of the Metamorphic Testing approach and to establish general criteria that can be used to quickly assess metamorphic relations with respect to their suitability. The latter is very important, since Metamorphic Testing is based on so-called metamorphic relations on input-output tuples, which can easily be found. It is, however, crucial to evaluate these relations according to their usefulness. The empirical study enables us to derive general rules that can be used to quickly assess metamorphic relations and identify those that should be considered and studied in more detail with other methods (e. g. with mutation analysis).