The effect of the number of inspectors on the defect estimates produced by capture-recapture models

Authors:
Gursimran Singh Walia;Jeffrey C. Carver;Nachiappan Nagappan
Affiliations:
Mississippi State University, Starkville, MS, USA;Mississippi State University, Starkville, MS, USA;Microsoft Research, Redmond, VA, USA
Venue:
Proceedings of the 30th international conference on Software engineering
Year:
2008

Citing 11
Cited 3

Estimating software fault content before coding

ICSE '92 Proceedings of the 14th international conference on Software engineering
Assessing Software Designs Using Capture-Recapture Methods

IEEE Transactions on Software Engineering - Special issue on software reliability
On the Statistical Analysis of the Number of Errors Remaining in a Software Design Document after Inspection

IEEE Transactions on Software Engineering
Defect content estimations from review data

Proceedings of the 20th international conference on Software engineering
A Comprehensive Evaluation of Capture-Recapture Models for Estimating Software Defect Content

IEEE Transactions on Software Engineering
The application of subjective estimates of effectiveness to controlling software inspections

Journal of Systems and Software - Special issue on software maintenance
Evaluating Capture-Recapture Models with Two Inspectors

IEEE Transactions on Software Engineering
An empirical methodology for introducing software processes

Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering
An Experimental Evaluation of an Experience-Based Capture-RecaptureMethod in Software Code Inspections

Empirical Software Engineering
Software Inspections: An Effective Verification Process

IEEE Software
A Comparison and Integration of Capture-Recapture Models and the Detection Profile Method

ISSRE '98 Proceedings of the The Ninth International Symposium on Software Reliability Engineering

Evaluation of capture-recapture models for estimating the abundance of naturally-occurring defects

Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
Transparent combination of expert and measurement data for defect prediction: an industrial case study

Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 2
More testers - The effect of crowd size and time restriction in software testing

Information and Software Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Inspections can be made more cost-effective by using capture-recapture methods to estimate post-inspection defects. Previous capture-recapture studies of inspections used relatively small data sets compared with those used in biology and wildlife research (the origin of the models). A common belief is that capture-recapture models underestimate the number of defects but their performance can be improved with data from more inspectors. This increase has not been evaluated in detail. This paper evaluates new estimators from biology not been previously applied to inspections. Using a data from seventy-three inspectors, we analyze the effect of the number of inspectors on the quality of estimates. Contrary to previous findings indicating that Jackknife is the best estimator, our results show that the SC estimators are better suited to software inspections. Our results also provide a detailed analysis of the number of inspectors necessary to obtain estimates within 5% to 20% of the actual.