Experimental evaluation in computer science: a quantitative study
Journal of Systems and Software
The type of evidence produced by empirical software engineers
REBSE '05 Proceedings of the 2005 workshop on Realising evidence-based software engineering
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
The Future of Empirical Methods in Software Engineering Research
FOSE '07 2007 Future of Software Engineering
Empirical evaluation in Computer Science research published by ACM
Information and Software Technology
A Case Study of Defect Introduction Mechanisms
CAiSE '09 Proceedings of the 21st International Conference on Advanced Information Systems Engineering
How to compare program comprehension in FOSD empirically: an experience report
FOSD '09 Proceedings of the First International Workshop on Feature-Oriented Software Development
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Systematic literature reviews in software engineering - A tertiary study
Information and Software Technology
Information and Software Technology
Refining the systematic literature review process--two participant-observer case studies
Empirical Software Engineering
A method for evaluating rigor and industrial relevance of technology evaluations
Empirical Software Engineering
Understanding technology use in global virtual teams: Research methodologies and methods
Information and Software Technology
Factors explaining external quality in 54 case studies of software development projects
EASE'09 Proceedings of the 13th international conference on Evaluation and Assessment in Software Engineering
A follow-up empirical evaluation of evidence based software engineering by undergraduate students
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
Research state of the art on GoF design patterns: A mapping study
Journal of Systems and Software
ACM SIGSOFT Software Engineering Notes
Hi-index | 0.00 |
We provide an assessment of the status of empirical software research by analyzing all refereed articles that appeared in the Journal of Empirical Software Engineering from its first issue in January 1996 through June 2006. The journal publishes empirical software research exclusively and it is the only journal to do so. The main findings are: 1. The dominant empirical methods are experiments and case studies. Other methods (correlational studies, meta analysis, surveys, descriptive approaches, ex post facto studies) occur infrequently; long-term studies are missing. About a quarter of the experiments are replications. 2. Professionals are used somewhat more frequently than students as subjects. 3. The dominant topics studied are measurement/metrics and tools/methods/frameworks. Metrics research is dominated by correlational and case studies without any experiments. 4. Important topics are underrepresented or absent, for example: programming languages, model driven developpment, formal methods, and others. The narrow focus on a few empirically researched topics is in contrast to the broad scope of software research.