Experimentation in software engineering
IEEE Transactions on Software Engineering
Science and Substance: A Challenge to Software Engineers
IEEE Software
Experimental evaluation in computer science: a quantitative study
Journal of Systems and Software
The role of experimentation in software engineering: past, current, and future
Proceedings of the 18th international conference on Software engineering
Software metrics (2nd ed.): a rigorous and practical approach
Software metrics (2nd ed.): a rigorous and practical approach
Building Knowledge through Families of Experiments
IEEE Transactions on Software Engineering
Empirical studies of software engineering: a roadmap
Proceedings of the Conference on The Future of Software Engineering
Empirical Software Engineering
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
The Experimental Paradigm in Software Engineering
Proceedings of the International Workshop on Experimental Software Engineering Issues: Critical Assessment and Future Directions
Panel: empirical validation: what, why, when, and how
Proceedings of the 25th International Conference on Software Engineering
Writing good software engineering research papers: minitutorial
Proceedings of the 25th International Conference on Software Engineering
Has Twenty-five Years of Empirical Software Engineering Made a Difference?
APSEC '02 Proceedings of the Ninth Asia-Pacific Software Engineering Conference
Experimental validation of new software technology
Lecture notes on empirical software engineering
Case Studies for Software Engineers
Proceedings of the 26th International Conference on Software Engineering
The type of evidence produced by empirical software engineers
REBSE '05 Proceedings of the 2005 workshop on Realising evidence-based software engineering
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
Basics of Software Engineering Experimentation
Basics of Software Engineering Experimentation
Synthetic designs: a new form of true experimental design for use in information systems development
Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Quality, productivity and economic benefits of software reuse: a review of industrial studies
Empirical Software Engineering
Experience applying the SPIN model checker to an industrial telecommunications system
Proceedings of the 30th international conference on Software engineering
CASCON '08 Proceedings of the 2008 conference of the center for advanced studies on collaborative research: meeting of minds
Systematic literature reviews in software engineering - A systematic literature review
Information and Software Technology
An update to experimental models for validating computer technology
Journal of Systems and Software
Techniques for empirical validationt
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
Toward credible evaluation of anomaly-based intrusion-detection methods
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
A systematic review of evaluation of variability management approaches in software product lines
Information and Software Technology
Identifying relevant studies in software engineering
Information and Software Technology
A method for evaluating rigor and industrial relevance of technology evaluations
Empirical Software Engineering
Service research challenges and solutions for the future internet
A study of transactional memory vs. locks in practice
Proceedings of the twenty-third annual ACM symposium on Parallelism in algorithms and architectures
Using grounded theory to study the experience of software development
Empirical Software Engineering
Reconciling perspectives: A grounded theory of how people manage the process of software development
Journal of Systems and Software
A status report on the evaluation of variability management approaches
EASE'09 Proceedings of the 13th international conference on Evaluation and Assessment in Software Engineering
Using a protocol template for case study planning
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
A note on rigour and replicability
ACM SIGSOFT Software Engineering Notes
A survey on software product line testing
Proceedings of the 16th International Software Product Line Conference - Volume 1
Variability in quality attributes of service-based software systems: A systematic literature review
Information and Software Technology
25 years of software engineering in Brazil: Beyond an insider's view
Journal of Systems and Software
A roadmap for software maintainability measurement
Proceedings of the 2013 International Conference on Software Engineering
The MSR cookbook: mining a decade of research
Proceedings of the 10th Working Conference on Mining Software Repositories
Replications of software engineering experiments
Empirical Software Engineering
Hi-index | 0.00 |
Critiques of the quantity and quality of empirical evaluations in software engineering have existed for quite some time. However such critiques are typically not empirically evaluated. This paper fills this gap by empirically analyzing papers published by ICSE, the prime research conference on Software Engineering. We present quantitative and qualitative results of a quasi-random experiment of empirical evaluations over the lifetime of the conference. Our quantitative results show the quantity of empirical evaluation has increased over 29 ICSE proceedings but we still have room to improve the soundness of empirical evaluations in ICSE proceedings. Our qualitative results point to specific areas of improvement in empirical evaluations.