An empirical study of process discipline and software quality

  • Authors:
  • Mainak Mazumdar;Mark Christopher Paulk

  • Affiliations:
  • University of Pittsburgh;University of Pittsburgh

  • Venue:
  • An empirical study of process discipline and software quality
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

There is a widespread, but not universal, belief in the software community that software organizations and projects can systematically improve their ability to meet commitments and build high-quality products using principles of software quality management. Quality affects cost and schedule, therefore the engineering practices that affect quality are also a management concern. Understanding the factors that influence software quality is crucial to the continuing maturation of the software industry; an improved understanding of software quality drivers will help software engineers and managers make more informed decisions in controlling and improving the software process. My research is motivated by a desire to understand the effect of disciplined processes and effective teams on improving performance and lessening variability with respect to software quality. Classroom data provides insight into interpersonal differences between competent professionals as increasingly disciplined processes are adopted. Project data using similar processes enables an exploration of the impact of effective teams on software quality. My results show that: (1) Program size, programmer ability, and disciplined processes significantly affect software quality. (2) Factors frequently used as surrogates for programmer ability, e.g., years of experience, and technology, e.g., programming language , do not significantly impact software quality. (3) Recommended practices are not necessarily followed even when processes are consistently performed, e.g., peer reviews may be consistently performed, but the review rates may exceed recommended practice for effective reviews. (4) When moving from ad hoc processes to disciplined processes, top-quartile performers improve more than 2X; bottom-quartile performers improve more than 4X. (5) Rigorous statistical techniques that allow for individual differences confirm the importance of process discipline and following recommended practice for improving software quality.