Methodology matters: doing research in the behavioral and social sciences
Human-computer interaction
Building Knowledge through Families of Experiments
IEEE Transactions on Software Engineering
Ethical Issues in Empirical Studies of Software Engineering
IEEE Transactions on Software Engineering
Replicating Software Engineering Experiments: Addressing the Tacit Knowledge Problem
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
Evidence-Based Software Engineering
Proceedings of the 26th International Conference on Software Engineering
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
The Future of Empirical Methods in Software Engineering Research
FOSE '07 2007 Future of Software Engineering
Mental models and programming aptitude
Proceedings of the 12th annual SIGCSE conference on Innovation and technology in computer science education
Analysis of Naive Bayes' assumptions on software fault data: An empirical study
Data & Knowledge Engineering
On the evaluation of recommender systems with recorded interactions
SUITE '09 Proceedings of the 2009 ICSE Workshop on Search-Driven Development-Users, Infrastructure, Tools and Evaluation
Proceedings of the First Asia-Pacific Symposium on Internetware
Using differences among replications of software engineering experiments to gain knowledge
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Improving code completion with program history
Automated Software Engineering
Applying empirical software engineering to software architecture: challenges and lessons learned
Empirical Software Engineering
1st International Workshop on Replication in Empirical Software Engineering Research (RESER)
Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 2
Replications types in experimental disciplines
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
Proceedings of the FSE/SDP workshop on Future of software engineering research
The role of non-exact replications in software engineering experiments
Empirical Software Engineering
Benefits and barriers of user evaluation in software engineering research
Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications
Replication of software engineering experiments
Empirical Software Engineering and Verification
EASE'10 Proceedings of the 14th international conference on Evaluation and Assessment in Software Engineering
Crossing the game threshold: a system for teaching basic programming constructs
Proceedings of the 13th International Conference of the NZ Chapter of the ACM's Special Interest Group on Human-Computer Interaction
A process for managing interaction between experimenters to get useful similar replications
Information and Software Technology
An externally replicated experiment to evaluate software testing methods
Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering
Can plans and situated actions be replicated?
Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
Information and Software Technology
Empirical Software Engineering
| Hi-index | 0.00 |
Replications play an important role in verifying empirical results. In this paper, we discuss our experiences performing a literal replication of a human subjects experiment that examined the relationship between a simple test for consistent use of mental models, and success in an introductory programming course. We encountered many difficulties in achieving comparability with the original experiment, due to a series of apparently minor differences in context. Based on this experience, we discuss the relative merits of replication, and suggest that, for some human subjects studies, literal replication may not be the the most effective strategy for validating the results of previous studies.