Towards building a solid empirical body of knowledge in testing techniques

  • Authors:

  • N. Juristo;A. M. Moreno;S. Vegas

  • Affiliations:

  • Universidad Politécnica de Madrid, Campus de Montegancedo, Madrid, Spain;Universidad Politécnica de Madrid, Campus de Montegancedo, Madrid, Spain;Universidad Politécnica de Madrid, Campus de Montegancedo, Madrid, Spain

  • Venue:
  • ACM SIGSOFT Software Engineering Notes
  • Year:
  • 2004

Quantified Score

Hi-index 0.01

Visualization

Abstract

Testing technique-related empirical studies have been performed for 25 years. We have managed to accumulate a fair number of experiments in this time, which might lead us to think that we now could have a sizeable empirically backed body of knowledge (BoK) on testing techniques. However, the experiments in this field have some flaws, and, consequently, the empirical BoK we have on testing techniques is far from solid. In this paper, we use the results of a survey that we did on empirical testing techniques studies to identify and discuss solutions that could lead to the formation of a solid empirical BoK. The solutions are related to two fundamental experimental issues: (1) the rigorousness of the experimental design and analysis, and (2) the need for a series of community-wide agreements to coordinate empirical research and assure that studies ratify and complement each other.