Interface Mutation Test Adequacy Criterion: An Empirical Evaluation

Authors:
Márcio Eduardo Delamaro;José Carlos Maldonado;Alberto Pasquini;Aditya P. Mathur
Affiliations:
Departamento de Informática Universidade Estadual de Maringá, Maringá, PR, Brazil delamaro@din.uem.br;Universidade de São Paulo, São Carlos, SP, Brazil jcmaldon@icmc.sc.usp.br;Robotics and Information Technology Division Italian Research Agency for New Technology, Energy and Environment (ENEA), Roma, Italy pasquini@casaccia.enea.it;Department of Computer Sciences Purdue University, West Lafayette, IN, USA apm@cs.purdue.edu
Venue:
Empirical Software Engineering
Year:
2001

Citing 24
Cited 1

Development and application of a white box approach to integration testing

Journal of Systems and Software - Special issue on the fifth Minnowbrook workshop on software performance evaluation
Selecting Software Test Data Using Data Flow Information

IEEE Transactions on Software Engineering
The coupling effect: fact or fiction

TAV3 Proceedings of the ACM SIGSOFT '89 third symposium on Software testing, analysis, and verification
Software testing techniques (2nd ed.)

Software testing techniques (2nd ed.)
Test data selection criteria for (software) integration testing

ISCI '90 Proceedings of the first international conference on systems integration on Systems integration '90
A Theory of Fault-Based Testing

IEEE Transactions on Software Engineering
Investigations of the software testing coupling effect

ACM Transactions on Software Engineering and Methodology (TOSEM)
Constraint-Based Automatic Test Data Generation

IEEE Transactions on Software Engineering
On mutation and data flow

On mutation and data flow
Reducing the cost of mutation testing: an empirical study

Journal of Systems and Software
Effect of test set minimization on fault detection effectiveness

Proceedings of the 17th international conference on Software engineering
A semantic model of program faults

ISSTA '96 Proceedings of the 1996 ACM SIGSOFT international symposium on Software testing and analysis
An experimental determination of sufficient mutant operators

ACM Transactions on Software Engineering and Methodology (TOSEM)
An experimental evaluation of selective mutation

ICSE '93 Proceedings of the 15th international conference on Software Engineering
Test set size minimization and fault detection effectiveness: a case study in a space application

Journal of Systems and Software
Interface Mutation: An Approach for Integration Testing

IEEE Transactions on Software Engineering
Selecting and Using Data for Integration Testing

IEEE Software
A Formal Analysis of the Fault-Detecting Ability of Testing Methods

IEEE Transactions on Software Engineering
Mutation Versus All-uses: An Empirical Evaluation of Cost, Strength and Effectiveness

Software Quality and Productivity: Theory, practice and training
Test Set Size Minimization and Fault Detection Effectiveness: A Case Study in a Space Application

COMPSAC '97 Proceedings of the 21st International Computer Software and Applications Conference
Interface Mutation: Assessing Testing Quality at Interprocedural Level

SCCC '99 Proceedings of the 19th International Conference of the Chilean Computer Science Society
Applying Testability to Reliability Estimation

ISSRE '98 Proceedings of the The Ninth International Symposium on Software Reliability Engineering
Mutation analysis of program test data

Mutation analysis of program test data
On mutation

On mutation

Code-based prioritization: a pre-testing effort to minimize post-release failures

Innovations in Systems and Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

An experiment was conducted to evaluate an inter-procedural test adequacy criterion named Interface Mutation. Program SPACE, developed for the European Space Agency (ESA), was used in this experiment. The development record available for this program was used to find the faults uncovered during its development. Using this information the test process was reproduced starting with a version of SPACE containing several faults and then applying Interface Mutation. Thus we could evaluate the fault revealing effectiveness of Interface Mutation. Results from the experiment suggest that (a) the application of Interface Mutation favors the selection of fault revealing test cases when they exist and (b) Interface Mutation tends to select fault revealing test cases more efficiently than in the case where random selection is used.