A scientific methodology for MIS case studies
MIS Quarterly
A set of principles for conducting and evaluating interpretive field studies in information systems
MIS Quarterly - Special issue on intensive research in information systems
The Handbook of Research Synthesis
The Handbook of Research Synthesis
Questioning Extreme Programming
Questioning Extreme Programming
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
(Quasi-)experimental studies in industrial settings
Lecture notes on empirical software engineering
Evidence-Based Software Engineering
Proceedings of the 26th International Conference on Software Engineering
Evidence-Based Software Engineering for Practitioners
IEEE Software
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
RE '06 Proceedings of the 14th IEEE International Requirements Engineering Conference
Journal of Systems and Software
Editorial: For the Special issue on Qualitative Software Engineering Research
Information and Software Technology
A Systematic Review of Software Development Cost Estimation Studies
IEEE Transactions on Software Engineering
The Future of Empirical Methods in Software Engineering Research
FOSE '07 2007 Future of Software Engineering
A Systematic Review of Theory Use in Software Engineering Experiments
IEEE Transactions on Software Engineering
Evaluating Pair Programming with Respect to System Complexity and Programmer Expertise
IEEE Transactions on Software Engineering
Search Engine Overlaps: Do they agree or disagree?
REBSE '07 Proceedings of the Second International Workshop on Realising Evidence-Based Software Engineering
Experiences using systematic review guidelines
Journal of Systems and Software
Systematic review: A systematic review of effect size in software engineering experiments
Information and Software Technology
Developing Search Strategies for Detecting Relevant Experiments for Systematic Reviews
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Applying Systematic Reviews to Diverse Study Types: An Experience Report
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Checklists for Software Engineering Case Study Research
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Evaluating guidelines for reporting empirical software engineering studies
Empirical Software Engineering
Empirical studies of agile software development: A systematic review
Information and Software Technology
A systematic review of quasi-experiments in software engineering
Information and Software Technology
Empirical paradigm - the role of experiments
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Requirements engineering for software product lines: A systematic literature review
Information and Software Technology
A systematic review of comparative evidence of aspect-oriented programming
Information and Software Technology
Can we evaluate the quality of software engineering experiments?
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
Information and Software Technology
A systematic review of evaluation of variability management approaches in software product lines
Information and Software Technology
Research synthesis in software engineering: A tertiary study
Information and Software Technology
A systematic mapping study of software product lines testing
Information and Software Technology
A systematic review of research on open source software in commercial software product development
Information and Software Technology
Critical issues on test-driven development
PROFES'11 Proceedings of the 12th international conference on Product-focused software process improvement
Towards a framework to characterize ubiquitous software projects
Information and Software Technology
A status report on the evaluation of variability management approaches
EASE'09 Proceedings of the 13th international conference on Evaluation and Assessment in Software Engineering
Experiences conducting systematic reviews from novices' perspective
EASE'10 Proceedings of the 14th international conference on Evaluation and Assessment in Software Engineering
A systematic review of research on open source software in commercial software product development
EASE'10 Proceedings of the 14th international conference on Evaluation and Assessment in Software Engineering
Information and Software Technology
A visual analysis approach to validate the selection review of primary studies in systematic reviews
Information and Software Technology
Electronic Notes in Theoretical Computer Science (ENTCS)
Computer Supported Cooperative Work
A tertiary study: experiences of conducting systematic literature reviews in software engineering
Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering
Hi-index | 0.00 |
Systematic reviews are only as good as the evidence they are based on. It is important, therefore, that users of systematic reviews know how much confidence they can place in the conclusions and recommendations arising from such reviews. In this paper we present an overview of some of the most influential systems for assessing the quality of individual primary studies and for grading the overall strength of a body of evidence. We also present an example of the use of such systems based on a systematic review of empirical studies of agile software development. Our findings suggest that the systems used in other disciplines for grading the strength of evidence for and reporting of systematic reviews, especially those that take account of qualitative and observational studies are of particular relevance for software engineering.