Experimental Evaluation of the Variation in Effectiveness for DC, FPC and MC/DC Test Criteria

  • Authors:
  • Kalpesh Kapoor;Jonathan Bowen

  • Affiliations:
  • -;-

  • Venue:
  • ISESE '03 Proceedings of the 2003 International Symposium on Empirical Software Engineering
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

Given a test criterion, the number of test-sets satisfyingthe criterion may be very large, with varying fault detectioneffectiveness. This paper presents an experimentalevaluation of the variation in fault detection effectivenessof all the test-sets for a given control-flow test criterionand a Boolean specification. The exhaustive experimentalapproach complements the earlier empirical studiesthat adopted analysis of some test-sets using random selectiontechniques. Three industrially used control-flow testingcriteria, Decision Coverage (DC), Full Predicate Coverage(FPC) and Modified Condition/Decision Coverage(MC/DC) have been analysed against four types of faults.The Boolean specifications used were taken from a past researchpaper and also generated randomly. To ensure thatit is the test-set property that influences the effectivenessand not the test-set size, a variation of DC, Decision Coverage/Random (DC/R), has also been considered againstFPC and MC/DC criteria. In addition, a further analysisof variation in average effectiveness with respect to numberof conditions in the decision has been done. The empiricalresults show that the MC/DC criterion is more reliable andstable in comparison to DC, DC/R and FPC.