Experimental evaluation in computer science: a quantitative study
Journal of Systems and Software
Building Knowledge through Families of Experiments
IEEE Transactions on Software Engineering
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
An experimental comparison of reading techniques for defect detection in UML design documents
Journal of Systems and Software
IEEE Transactions on Software Engineering
Perspective-based Usability Inspection: An Empirical Validationof Efficacy
Empirical Software Engineering
Benchmarking Kappa: Interrater Agreement in Software ProcessAssessments
Empirical Software Engineering
Empirical Software Engineering
Hints for Reviewing Empirical Work in Software Engineering
Empirical Software Engineering
Empirical Software Engineering
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
Can Results from Software Engineering Experiments be Safely Combined?
METRICS '99 Proceedings of the 6th International Symposium on Software Metrics
Research Synthesis in Software Engineering: A Case for Meta-Analysis
METRICS '99 Proceedings of the 6th International Symposium on Software Metrics
Replicating Software Engineering Experiments: Addressing the Tacit Knowledge Problem
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
Conducting Realistic Experiments in Software Engineering
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
Developing techniques for using software documents: a series of empirical studies
Developing techniques for using software documents: a series of empirical studies
Evidence-Based Software Engineering
Proceedings of the 26th International Conference on Software Engineering
Using Students as Subjects in Requirements Prioritization
ISESE '04 Proceedings of the 2004 International Symposium on Empirical Software Engineering
Basics of Software Engineering Experimentation
Basics of Software Engineering Experimentation
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
What Do We Know about Defect Detection Methods?
IEEE Software
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Information and Software Technology
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
A checklist for integrating student empirical studies with research and teaching goals
Empirical Software Engineering
Empirical software engineering: teaching methods and conducting studies
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
Systematic literature reviews in software engineering - A tertiary study
Information and Software Technology
Refining the systematic literature review process--two participant-observer case studies
Empirical Software Engineering
Benefits and barriers of user evaluation in software engineering research
Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications
Empirical Software Engineering
Is external code quality correlated with programming experience or feelgood factor?
XP'06 Proceedings of the 7th international conference on Extreme Programming and Agile Processes in Software Engineering
Issues in applying empirical software engineering to software architecture
ECSA'07 Proceedings of the First European conference on Software Architecture
The impact of test-driven development on software development productivity: an empirical study
EuroSPI'07 Proceedings of the 14th European conference on Software Process Improvement
Comparing attack trees and misuse cases in an industrial setting
Information and Software Technology
Hi-index | 0.00 |
There is a need to identify factors that affect the result of empirical studies in software engineering research. It is still the case that seemingly identical replications of controlled experiments result in different conclusions due to the fact that all factors describing the experiment context are not clearly defined and hence controlled. In this article, a scheme for describing the participants of controlled experiments is proposed and evaluated. It consists of two main factors, the incentives for participants in the experiment and the experience of the participants. The scheme has been evaluated by classifying a set of previously conducted experiments from literature. It can be concluded that the scheme was easy to use and understand. It is also found that experiments that are classified in the same way to a large extent point at the same results, which indicates that the scheme addresses relevant factors.