An Experimental Evaluation of Inspection and Testing for Detection of Design Faults

  • Authors:
  • Carina Andersson;Thomas Thelin;Per Runeson;Nina Dzamashvili

  • Affiliations:
  • -;-;-;-

  • Venue:
  • ISESE '03 Proceedings of the 2003 International Symposium on Empirical Software Engineering
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

The two most common strategies for verification and validation,inspection and testing, are in a controlled experimentevaluated in terms of their fault detection capabilities.These two techniques are in the previous work comparedapplied to code. In order to compare the efficiency and effectivenessof these techniques on a higher abstraction levelthan code, this experiment investigates inspection of designdocuments and testing of the corresponding program, to detectfaults originating from the design document. Usage-basedreading (UBR) and usage-based testing (UBT) werechosen for inspections and testing, respectively. These techniquesprovide similar aid to the reviewers as to the testers.The purpose of both fault detection techniques is to focusthe inspection and testing from a user's viewpoint. The experimentwas conducted with 51 Master's students in a two-factorblocked design; each student applied each techniqueonce, each application on different versions of the sameprogram. The two versions contained different sets of faults,including 13 and 14 faults, respectively. The general resultsfrom this study show that when the two groups of subjectsare combined, the efficiency and effectiveness are significantlyhigher for usage-based reading and that testing tendsto require more learning. Rework is not taken into account,thus the experiment indicates strong support for design inspectionover testing.