Refactoring: improving the design of existing code
Refactoring: improving the design of existing code
Grading essays in computer ethics: rubrics considered helpful
SIGCSE '02 Proceedings of the 33rd SIGCSE technical symposium on Computer science education
Software Metrics: A Rigorous and Practical Approach
Software Metrics: A Rigorous and Practical Approach
Conflict in collaborative software development
SIGMIS CPR '03 Proceedings of the 2003 SIGMIS conference on Computer personnel research: Freedom in Philadelphia--leveraging differences and diversity in the IT workforce
Assessing test-driven development at IBM
Proceedings of the 25th International Conference on Software Engineering
Implications of test-driven development: a pilot study
OOPSLA '03 Companion of the 18th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications
Test-Driven Development as a Defect-Reduction Practice
ISSRE '03 Proceedings of the 14th International Symposium on Software Reliability Engineering
An initial investigation of test driven development in industry
Proceedings of the 2003 ACM symposium on Applied computing
A Prototype Empirical Evaluation of Test Driven Development
METRICS '04 Proceedings of the Software Metrics, 10th International Symposium
A cross-program investigation of students' perceptions of agile methods
Proceedings of the 27th international conference on Software engineering
On the Effectiveness of the Test-First Approach to Programming
IEEE Transactions on Software Engineering
Extreme Programming Explained: Embrace Change (2nd Edition)
Extreme Programming Explained: Embrace Change (2nd Edition)
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
On the Influence of Test-Driven Development on Software Design
CSEET '06 Proceedings of the 19th Conference on Software Engineering Education & Training
Empirical Assessment of Test-First Approach
TAIC-PART '06 Proceedings of the Testing: Academic & Industrial Conference on Practice And Research Techniques
Results from introducing component-level test automation and test-driven development
Journal of Systems and Software - Special issue: Selected papers from the 11th Asia Pacific software engineering conference (APSEC 2004)
Evaluating the efficacy of test-driven development: industrial case studies
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Evaluating advantages of test driven development: a controlled experiment with professionals
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
A Leveled Examination of Test-Driven Development Acceptance
ICSE '07 Proceedings of the 29th international conference on Software Engineering
The Future of Empirical Methods in Software Engineering Research
FOSE '07 2007 Future of Software Engineering
On the Sustained Use of a Test-Driven Development Practice at IBM
AGILE '07 Proceedings of the AGILE 2007
Applying Systematic Reviews to Diverse Study Types: An Experience Report
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
An Experimental Evaluation of the Effectiveness and Efficiency of the Test Driven Development
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Controlled experimentation on adaptations of pair programming
Information Technology and Management
Test-driven learning in early programming courses
Proceedings of the 39th SIGCSE technical symposium on Computer science education
Test-driven development: can it work for spreadsheets?
Proceedings of the 4th international workshop on End-user software engineering
Empirical Software Engineering
A survey of evidence for test-driven development in academia
ACM SIGCSE Bulletin
Test-driven development in education: experiences with critical viewpoints
Proceedings of the 13th annual conference on Innovation and technology in computer science education
Systematic literature reviews in software engineering - A systematic literature review
Information and Software Technology
Empirical investigation towards the effectiveness of Test First programming
Information and Software Technology
ICSEA '08 Proceedings of the 2008 The Third International Conference on Software Engineering Advances
Implications of integrating test-driven development into CS1/CS2 curricula
Proceedings of the 40th ACM technical symposium on Computer science education
Guidelines for conducting and reporting case study research in software engineering
Empirical Software Engineering
The effectiveness of pair programming: A meta-analysis
Information and Software Technology
Proceedings of the 2005 conference on Software Engineering: Evolution and Emerging Technologies
Evaluating Test-Driven Development in an Industry-Sponsored Capstone Project
ITNG '09 Proceedings of the 2009 Sixth International Conference on Information Technology: New Generations
Extending Test-Driven Development for Robust Web Services
DEPEND '09 Proceedings of the 2009 Second International Conference on Dependability
Information and Software Technology
Context in industrial software engineering research
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Test-Driven Development: An Empirical Evaluation of Agile Practice
Test-Driven Development: An Empirical Evaluation of Agile Practice
ICSTW '10 Proceedings of the 2010 Third International Conference on Software Testing, Verification, and Validation Workshops
What Do We Know about Test-Driven Development?
IEEE Software
Empirical Studies on Quality in Agile Practices: A Systematic Literature Review
QUATIC '10 Proceedings of the 2010 Seventh International Conference on the Quality of Information and Communications Technology
Test-Driven Development - Still a Promising Approach?
QUATIC '10 Proceedings of the 2010 Seventh International Conference on the Quality of Information and Communications Technology
Measuring and predicting software productivity: A systematic map and review
Information and Software Technology
Impact of test-driven development on productivity, code and tests: A controlled experiment
Information and Software Technology
Empirical Software Engineering
A method for evaluating rigor and industrial relevance of technology evaluations
Empirical Software Engineering
Factors Limiting Industrial Adoption of Test Driven Development: A Systematic Review
ICST '11 Proceedings of the 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation
Regression Test Selection Techniques for Test-Driven Development
ICSTW '11 Proceedings of the 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops
Critical issues on test-driven development
PROFES'11 Proceedings of the 12th international conference on Product-focused software process improvement
The effectiveness of test-driven development: an industrial case study
Software Quality Control
Bug localization in test-driven development
Advances in Software Engineering
Identifying Strategies for Study Selection in Systematic Reviews and Maps
ESEM '11 Proceedings of the 2011 International Symposium on Empirical Software Engineering and Measurement
Lessons learned from an XP experiment with students: test-first needs more teachings
PROFES'06 Proceedings of the 7th international conference on Product-Focused Software Process Improvement
An XP experiment with students: setup and problems
PROFES'05 Proceedings of the 6th international conference on Product Focused Software Process Improvement
Comparison between test driven development and waterfall development in a small-scale project
XP'06 Proceedings of the 7th international conference on Extreme Programming and Agile Processes in Software Engineering
Comparing the Defect Reduction Benefits of Code Inspection and Test-Driven Development
IEEE Transactions on Software Engineering
Experimentation in Software Engineering
Experimentation in Software Engineering
Systematic literature studies: database searches vs. backward snowballing
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement
The impact of test-driven development on software development productivity: an empirical study
EuroSPI'07 Proceedings of the 14th European conference on Software Process Improvement
Editorial: Systematic literature reviews in software engineering
Information and Software Technology
The Effects of Test-Driven Development on External Quality and Productivity: A Meta-Analysis
IEEE Transactions on Software Engineering
IWSM-MENSURA '13 Proceedings of the 2013 Joint Conference of the 23nd International Workshop on Software Measurement (IWSM) and the 8th International Conference on Software Process and Product Measurement
Hi-index | 0.00 |
Context: Test driven development (TDD) has been extensively researched and compared to traditional approaches (test last development, TLD). Existing literature reviews show varying results for TDD. Objective: This study investigates how the conclusions of existing literature reviews change when taking two study quality dimension into account, namely rigor and relevance. Method: In this study a systematic literature review has been conducted and the results of the identified primary studies have been analyzed with respect to rigor and relevance scores using the assessment rubric proposed by Ivarsson and Gorschek 2011. Rigor and relevance are rated on a scale, which is explained in this paper. Four categories of studies were defined based on high/low rigor and relevance. Results: We found that studies in the four categories come to different conclusions. In particular, studies with a high rigor and relevance scores show clear results for improvement in external quality, which seem to come with a loss of productivity. At the same time high rigor and relevance studies only investigate a small set of variables. Other categories contain many studies showing no difference, hence biasing the results negatively for the overall set of primary studies. Given the classification differences to previous literature reviews could be highlighted. Conclusion: Strong indications are obtained that external quality is positively influenced, which has to be further substantiated by industry experiments and longitudinal case studies. Future studies in the high rigor and relevance category would contribute largely by focusing on a wider set of outcome variables (e.g. internal code quality). We also conclude that considering rigor and relevance in TDD evaluation is important given the differences in results between categories and in comparison to previous reviews.