Understanding the Impact of Assumptions on Experimental Validity

  • Authors:
  • Jeff Carver;John Van Voorhis;Victor Basili

  • Affiliations:
  • University of Maryland;University of Maryland;University of Maryland and Fraunhofer Center for Experimental Software Engineering

  • Venue:
  • ISESE '04 Proceedings of the 2004 International Symposium on Empirical Software Engineering
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Empirical studies are used frequently in software engineering as a method for studying and understanding software engineering techniques and methods. When conducting studies, researchers make assumptions about three objects, people, processes and products. Researchers usually focus their study on only one of those objects. But, regardless of which type of object is chosen as the focus of the study, researchers make assumptions about all three objects. The impact of those assumptions on experimental validity varies depending on the focus of the study. In this paper, we discuss the various types of assumptions that researchers make. We relate those assumptions back to some concepts from social science research. We then use the results of a people-focused study to illustrate the impact of the assumptions on the results of that study.