Experimental evaluation in computer science: a quantitative study
Journal of Systems and Software
Overlooked Aspects of COTS-Based Development
IEEE Software
Evidence-Based Software Engineering
Proceedings of the 26th International Conference on Software Engineering
Evidence-Based Software Engineering for Practitioners
IEEE Software
Experimental context classification: incentives and experience of subjects
Proceedings of the 27th international conference on Software engineering
An analysis of data sets used to train and validate cost prediction systems
PROMISE '05 Proceedings of the 2005 workshop on Predictor models in software engineering
The type of evidence produced by empirical software engineers
REBSE '05 Proceedings of the 2005 workshop on Realising evidence-based software engineering
The Clients' Impact on Effort Estimation Accuracy in Software Development Projects
METRICS '05 Proceedings of the 11th IEEE International Software Metrics Symposium
Teaching Evidence-Based Software Engineering to University Students
METRICS '05 Proceedings of the 11th IEEE International Software Metrics Symposium
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
Evidence-Based Guidelines for Assessment of Software Development Cost Uncertainty
IEEE Transactions on Software Engineering
RE '06 Proceedings of the 14th IEEE International Requirements Engineering Conference
EDOCW '06 Proceedings of the 10th IEEE on International Enterprise Distributed Object Computing Conference Workshops
Journal of Systems and Software
A Systematic Review of Software Development Cost Estimation Studies
IEEE Transactions on Software Engineering
Software project economics: a roadmap
FOSE '07 2007 Future of Software Engineering
Cross versus Within-Company Cost Estimation Studies: A Systematic Review
IEEE Transactions on Software Engineering
Controversy Corner: A new research agenda for tool integration
Journal of Systems and Software
Quality, productivity and economic benefits of software reuse: a review of industrial studies
Empirical Software Engineering
Systematic review: A systematic review of effect size in software engineering experiments
Information and Software Technology
SIGDOC '07 Proceedings of the 25th annual ACM international conference on Design of communication
Comparing Local and Global Software Effort Estimation Models -- Reflections on a Systematic Review
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Evidence relating to Object-Oriented software design: A survey
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Journal of Software Maintenance and Evolution: Research and Practice
Software process improvement in small and medium software enterprises: a systematic review
Software Quality Control
Systematic review: Systematic review of organizational motivations for adopting CMM-based SPI
Information and Software Technology
In search of `architectural knowledge'
Proceedings of the 3rd international workshop on Sharing and reusing architectural knowledge
Data sets and data quality in software engineering
Proceedings of the 4th international workshop on Predictor models in software engineering
Empirical studies of agile software development: A systematic review
Information and Software Technology
Motivation in Software Engineering: A systematic literature review
Information and Software Technology
The Role of Deliberate Artificial Design Elements in Software Engineering Experiments
IEEE Transactions on Software Engineering
How Does a Measurement Programme Evolve in Software Organizations?
PROFES '08 Proceedings of the 9th international conference on Product-Focused Software Process Improvement
Where Is the Proof? - A Review of Experiences from Applying MDE in Industry
ECMDA-FA '08 Proceedings of the 4th European conference on Model Driven Architecture: Foundations and Applications
Systematic literature reviews in software engineering - A systematic literature review
Information and Software Technology
A Systematic Literature Review of Approaches to Reengineering for Multi-Channel Access
CSMR '08 Proceedings of the 2008 12th European Conference on Software Maintenance and Reengineering
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Status of empirical research in software engineering
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
A quantitative assessment of requirements engineering publications-1963-2006
REFSQ'07 Proceedings of the 13th international working conference on Requirements engineering: foundation for software quality
Reflections on 10 years of software process simulation modeling: a systematic review
ICSP'08 Proceedings of the Software process, 2008 international conference on Making globally distributed software development a success story
Systematic literature reviews in software engineering - A tertiary study
Information and Software Technology
An evaluation of quality checklist proposals: a participant-observer case study
EASE'09 Proceedings of the 13th international conference on Evaluation and Assessment in Software Engineering
The value of mapping studies: a participantobserver case study
EASE'10 Proceedings of the 14th international conference on Evaluation and Assessment in Software Engineering
Using a protocol template for case study planning
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
Lessons learnt undertaking a large-scale systematic literature review
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
A review of studies on expert estimation of software development effort
Journal of Systems and Software
Research in computer science: an empirical study
Journal of Systems and Software
Tailoring and introduction of the rational unified process
EuroSPI'07 Proceedings of the 14th European conference on Software Process Improvement
Systematic literature reviews in software engineering - A tertiary study
Information and Software Technology
Can we evaluate the quality of software engineering experiments?
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
Using mapping studies as the basis for further research - A participant-observer case study
Information and Software Technology
Information and Software Technology
Variability in quality attributes of service-based software systems: A systematic literature review
Information and Software Technology
International Journal of Human Capital and Information Technology Professionals
Hi-index | 0.00 |
Systematic literature reviews (SLRs) are a major tool for supporting evidence-based software engineering. Adapting the procedures involved in such a review to meet the needs of software engineering and its literature remains an ongoing process. As part of this process of refinement, we undertook two case studies which aimed 1) to compare the use of targeted manual searches with broad automated searches and 2) to compare different methods of reaching a consensus on quality. For Case 1, we compared a tertiary study of systematic literature reviews published between January 1, 2004 and June 30, 2007 which used a manual search of selected journals and conferences and a replication of that study based on a broad automated search. We found that broad automated searches find more studies than manual restricted searches, but they may be of poor quality. Researchers undertaking SLRs may be justified in using targeted manual searches if they intend to omit low quality papers, or they are assessing research trends in research methodologies. For Case 2, we analyzed the process used to evaluate the quality of SLRs. We conclude that if quality evaluation of primary studies is a critical component of a specific SLR, assessments should be based on three independent evaluators incorporating at least two rounds of discussion.