Qualitative Methods in Empirical Studies of Software Engineering
IEEE Transactions on Software Engineering
Empirical Software Engineering
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
Issues in Using Students in Empirical Studies in Software Engineering Education
METRICS '03 Proceedings of the 9th International Symposium on Software Metrics
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
Design and evaluation of the ModelHealth toolchain for continuity of care web services
Automated Software Engineering
| Hi-index | 0.00 |
The purpose of this working group was to identify which role controlled experiments play in the field of empirical Software Engineering. The discussions resulted in a list of motivational factors, challenges, and improvements suggestions. The main outcome is that, although the empirical Software Engineering community, over the last 14 years, has matured with regard to doing controlled experiments, there is still room for improvement. By now the community has understood under which conditions it is possible to empirically evaluate Software Engineering methods, techniques, and tools, but the way controlled experiments are designed, performed, and reported still lacks the level of quality of other disciplines such as social sciences or medicine. The generalizability of the results of controlled experiments is one major concern. Furthermore, more emphasis should be put on the role of empirical Software Engineering education.