Improving Fault-based Conformance Testing

Authors:
Bernhard K. Aichernig;Martin Weiglhofer;Franz Wotawa
Affiliations:
Institute for Software Technology, Graz University of Technology, Graz, Austria;Institute for Software Technology, Graz University of Technology, Graz, Austria;Institute for Software Technology, Graz University of Technology, Graz, Austria
Venue:
Electronic Notes in Theoretical Computer Science (ENTCS)
Year:
2008

Citing 11
Cited 1

Program testing by specification mutation

Computer Languages
Test Selection Based on Communicating Nondeterministic Finite-State Machines Using a Generalized Wp-Method

IEEE Transactions on Software Engineering
Efficient on-the-fly model-checking for regular alternation-free mu-calculus

Science of Computer Programming - Special issure on formal methods for industrial critical systems (FMICS 2000)
Using Model Checking to Generate Tests from Specifications

ICFEM '98 Proceedings of the Second IEEE International Conference on Formal Engineering Methods
TGV: theory, principles and algorithms: A tool for the automatic synthesis of conformance test cases for non-deterministic reactive systems

International Journal on Software Tools for Technology Transfer (STTT) - Special section on high-level test of complex systems
Test purpose generation in an industrial application

Proceedings of the 3rd international workshop on Advances in model-based testing
Protocol Conformance Testing a SIP Registrar: an Industrial Application of Formal Methods

SEFM '07 Proceedings of the Fifth IEEE International Conference on Software Engineering and Formal Methods
Nondeterministic Testing with Linear Model-Checker Counterexamples

QSIC '07 Proceedings of the Seventh International Conference on Quality Software
"On the fly" input output conformance verification

SE '08 Proceedings of the IASTED International Conference on Software Engineering
Conformance tests as checking experiments for partial nondeterministic FSM

FATES'05 Proceedings of the 5th international conference on Formal Approaches to Software Testing
From faults via test purposes to test cases: on the fault-based testing of concurrent systems

FASE'06 Proceedings of the 9th international conference on Fundamental Approaches to Software Engineering

Compositional Verification of Input-Output Conformance via CSP Refinement Checking

ICFEM '09 Proceedings of the 11th International Conference on Formal Engineering Methods: Formal Methods and Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

Fault-based conformance testing is a conformance testing strategy that relies on specific fault models. Previously, this mutation testing technique has been applied to protocol specifications. Although a practical case study of web-server testing has been conducted, we observed several issues when applying this method in a large industrial project. In this paper, we discuss the foundations, techniques and tools to overcome these shortcomings. More specifically, we show a solution to the problem of state-space explosion in generating mutation tests for industrial scale applications. Furthermore, the previous approach used the counterexamples of a bisimulation check (between the original and the mutant) as test purposes. With respect to input-output conformance (ioco), this is an over-approximation resulting in more tests than are necessary. Hence, we propose to use an ioco-checker in order to generate less test cases. An industrial case study demonstrates these improvements.