Comparing the Effectiveness of Software Testing Strategies
IEEE Transactions on Software Engineering
Assessing Software Review Meetings: Results of a Comparative Analysis of Two Experimental Studies
IEEE Transactions on Software Engineering
Comparing and combining software defect detection techniques: a replicated empirical study
ESEC '97/FSE-5 Proceedings of the 6th European SOFTWARE ENGINEERING conference held jointly with the 5th ACM SIGSOFT international symposium on Foundations of software engineering
Applying meta-analytical procedures to software engineering experiments
Journal of Systems and Software
An Empirical Evaluation of Three Defect-Detection Techniques
Proceedings of the 5th European Software Engineering Conference
Replicated studies: building a body of knowledge about software reading techniques
Lecture notes on empirical software engineering
(Quasi-)experimental studies in industrial settings
Lecture notes on empirical software engineering
Developing techniques for using software documents: a series of empirical studies
Developing techniques for using software documents: a series of empirical studies
Reviewing 25 Years of Testing Technique Experiments
Empirical Software Engineering
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
Analysis of the influence of communication between researchers on experiment replication
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
The role of replications in empirical software engineering--a word of warning
Empirical Software Engineering
The role of replications in Empirical Software Engineering
Empirical Software Engineering
On the difficulty of replicating human subjects studies in software engineering
Proceedings of the 30th international conference on Software engineering
ACM SIGSOFT Software Engineering Notes
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
The effects of neuroticism on pair programming: an empirical study in the higher education context
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
Comparison of similarity metrics for refactoring detection
Proceedings of the 8th Working Conference on Mining Software Repositories
Identifying moderator variables through requirements elicitation experiments limitations
Proceedings of the 12th International Conference on Product Focused Software Development and Process Improvement
Replication of software engineering experiments
Empirical Software Engineering and Verification
EASE'10 Proceedings of the 14th international conference on Evaluation and Assessment in Software Engineering
Evaluating defect prediction approaches: a benchmark and an extensive comparison
Empirical Software Engineering
Building a second opinion: learning cross-company data
Proceedings of the 9th International Conference on Predictive Models in Software Engineering
Empirical Software Engineering
On the role of tests in test-driven development: a differentiated and partial replication
Empirical Software Engineering
Replications of software engineering experiments
Empirical Software Engineering
Hi-index | 0.00 |
In no science or engineering discipline does it make sense to speak of isolated experiments. The results of a single experiment cannot be viewed as representative of the underlying reality. The concept of experiment is closely related to replication. Experiment replication is the repetition of an experiment to double-check its results. Multiple replications of an experiment increase the credibility of its results. Software engineering has tried its hand at the identical repetition of experiments in the way of the natural sciences (physics, chemistry, etc.). After numerous attempts over the years, excepting experiments repeated by the same researchers at the same site, no exact replications have yet been achieved. One key reason for this is the complexity of the software development setting. This complexity prevents the many experimental conditions from being reproduced identically. This paper reports research into whether non-exact replications can be of any use. We propose a process that allows researchers to generate new knowledge when running non-exact replications. To illustrate the advantages of the proposed process, two different replications of an experiment are shown.