Science and Substance: A Challenge to Software Engineers
IEEE Software
Building Knowledge through Families of Experiments
IEEE Transactions on Software Engineering
Empirical Software Engineering
Case Studies for Method and Tool Evaluation
IEEE Software
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
An Investigation of the Applicability of Design of Experiments to Software Testing
SEW '02 Proceedings of the 27th Annual NASA Goddard Software Engineering Workshop (SEW-27'02)
Reviewing 25 Years of Testing Technique Experiments
Empirical Software Engineering
Software Fault Interactions and Implications for Software Testing
IEEE Transactions on Software Engineering
Guidelines for conducting and reporting case study research in software engineering
Empirical Software Engineering
Towards a General Framework for Evaluating Software Development Methodologies
COMPSAC '10 Proceedings of the 2010 IEEE 34th Annual Computer Software and Applications Conference
A Methodological Framework for Evaluating Software Testing Techniques and Tools
QSIC '12 Proceedings of the 2012 12th International Conference on Quality Software
| Hi-index | 0.00 |
Case studies for evaluating tools in software engineering are powerful. Although they cannot achieve the scientific rigour of formal experiments, the results can provide sufficient information to help companies judge if a specific technology being evaluated will benefit their organization. This paper reports on a case study done for evaluating a combinatorial testing tool in a realistic industrial environment with real objects and subjects. The case study has been executed at Sulake, a company that develops social entertainment games and whose main product is Habbo Hotel, a social network community in the shape of an online Hotel that is visited by millions of teenagers every week all around the world. This paper describes the experimental design of the case study together with the results and decisions that Sulake has taken about the further study, adoption and implantation of these type of tools.