Quantitative analysis of faults and failures with multiple releases of softpm

  • Authors:
  • Shujian Wu;Qing Wang;Ye Yang

  • Affiliations:
  • Chinese Academy of Sciences, Beijing, China;Chinese Academy of Sciences, Beijing, China;Chinese Academy of Sciences, Beijing, China

  • Venue:
  • Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

To date, very little published empirical data has reported on the quality and reliability aspects of commercial software systems. In this paper, we present quantitative empirical study results on faults and failures with four releases of SoftPM [29, 31], one of the most widely adopted software project management tools in China. Our approach verifies Fenton's Hypotheses in [11] and explores the relationship between pre-release faults and post-release failures in four releases of SoftPM. We also present the distribution of Mean Time to Remove Faults (MTRF), the review and testing efficiency, and the fault and failure data for benchmarking. Our study shows that a few modules that are not fault-prone contain most failures in the field and most faults detected at an early stage cost less time to be fixed and removed. Our results have been validated and evaluated at four subsequent major releases of SoftPM at the laboratory for Internet Software Technologies of the Institute of Software, Chinese Academy of Sciences (iTechs).