Comparing the Effectiveness of Software Testing Strategies
IEEE Transactions on Software Engineering
Experimental design and analysis in software engineering: Part 2: how to set up and experiment
ACM SIGSOFT Software Engineering Notes
Comparing and combining software defect detection techniques: a replicated empirical study
ESEC '97/FSE-5 Proceedings of the 6th European SOFTWARE ENGINEERING conference held jointly with the 5th ACM SIGSOFT international symposium on Foundations of software engineering
Building Knowledge through Families of Experiments
IEEE Transactions on Software Engineering
Applying meta-analytical procedures to software engineering experiments
Journal of Systems and Software
A Replicated Experiment to Assess Requirements InspectionTechniques
Empirical Software Engineering
Further Experiences with Scenarios and Checklists
Empirical Software Engineering
Empirical Software Engineering
An Extended Replication of an Experiment for AssessingMethods for Software Requirements Inspections
Empirical Software Engineering
Comparing Detection Methods for Software Requirements Inspections: A Replicated Experiment
IEEE Transactions on Software Engineering
Can Results from Software Engineering Experiments be Safely Combined?
METRICS '99 Proceedings of the 6th International Symposium on Software Metrics
Research Synthesis in Software Engineering: A Case for Meta-Analysis
METRICS '99 Proceedings of the 6th International Symposium on Software Metrics
Replicating Software Engineering Experiments: Addressing the Tacit Knowledge Problem
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
Reviewing 25 Years of Testing Technique Experiments
Empirical Software Engineering
Analysis of the influence of communication between researchers on experiment replication
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Systematic review: A systematic review of effect size in software engineering experiments
Information and Software Technology
Triangulation as a basis for knowledge discovery in software engineering
Empirical Software Engineering
The role of replications in empirical software engineering--a word of warning
Empirical Software Engineering
The role of replications in Empirical Software Engineering
Empirical Software Engineering
On the difficulty of replicating human subjects studies in software engineering
Proceedings of the 30th international conference on Software engineering
A Framework for Software Engineering Experimental Replications
ICECCS '08 Proceedings of the 13th IEEE International Conference on on Engineering of Complex Computer Systems
The effectiveness of pair programming: A meta-analysis
Information and Software Technology
Using differences among replications of software engineering experiments to gain knowledge
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Replicating software engineering experiments: a poisoned chalice or the Holy Grail
Information and Software Technology
A review of studies on expert estimation of software development effort
Journal of Systems and Software
Hi-index | 0.00 |
Experimentation has played a major role in scientific advancement. Replication is one of the essentials of the experimental methods. In replications, experiments are repeated aiming to check their results. Successful replication increases the validity and reliability of the outcomes observed in an experiment. There is debate about the best way of running replications of Software Engineering (SE) experiments. Some of the questions that have cropped up in this debate are, "Should replicators reuse the baseline experiment materials? Which is the adequate sort of communication among experimenters and replicators if any? What elements of the experimental structure can be changed and still be considered a replication instead of a new experiment?". A deeper understanding of the concept of replication should help to clarify these issues as well as increase and improve replications in SE experimental practices. In this chapter, we study the concept of replication in order to gain insight. The chapter starts with an introduction to the importance of replication and the state of replication in ESE. Then we discuss replication from both the statistical and scientific viewpoint. Based on a review of the diverse types of replication used in other scientific disciplines, we identify the different types of replication that are feasible to be run in our discipline. Finally, we present the different purposes that replication can serve in Experimental Software Engineering (ESE).