Experimentation in software engineering
IEEE Transactions on Software Engineering
By the way, did anyone study any real programmers?
Papers presented at the first workshop on empirical studies of programmers on Empirical studies of programmers
How effective are software engineering methods?
Journal of Systems and Software
Experimental evaluation in computer science: a quantitative study
Journal of Systems and Software
The role of experimentation in software engineering: past, current, and future
Proceedings of the 18th international conference on Software engineering
Building Knowledge through Families of Experiments
IEEE Transactions on Software Engineering
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
Guide to the Software Engineering Body of Knowledge - SWEBOK
Guide to the Software Engineering Body of Knowledge - SWEBOK
A Preliminary Software Engineering Theory as Investigated by Published Experiments
Empirical Software Engineering
A Review of Experimental Investigations into Object-Oriented Technology
Empirical Software Engineering
Hints for Reviewing Empirical Work in Software Engineering
Empirical Software Engineering
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
The Experimental Paradigm in Software Engineering
Proceedings of the International Workshop on Experimental Software Engineering Issues: Critical Assessment and Future Directions
Writing good software engineering research papers: minitutorial
Proceedings of the 25th International Conference on Software Engineering
Research Synthesis in Software Engineering: A Case for Meta-Analysis
METRICS '99 Proceedings of the 6th International Symposium on Software Metrics
Conducting Realistic Experiments in Software Engineering
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
An assessment of systems and software engineering scholars and institutions (1998-2002)
Journal of Systems and Software
Reviewing 25 Years of Testing Technique Experiments
Empirical Software Engineering
An analysis of research in computing disciplines
Communications of the ACM - Wireless sensor networks
IEEE Transactions on Software Engineering
Experimental context classification: incentives and experience of subjects
Proceedings of the 27th international conference on Software engineering
Editor's comment: theoretically speaking
MIS Quarterly
A review of studies on expert estimation of software development effort
Journal of Systems and Software
Journal of Systems and Software
On the success of empirical studies in the international conference on software engineering
Proceedings of the 28th international conference on Software engineering
Evaluating guidelines for empirical software engineering studies
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Scientific research ontology to support systematic review in software engineering
Advanced Engineering Informatics
The Future of Empirical Methods in Software Engineering Research
FOSE '07 2007 Future of Software Engineering
A Systematic Review of Theory Use in Software Engineering Experiments
IEEE Transactions on Software Engineering
REBSE '07 Proceedings of the Second International Workshop on Realising Evidence-Based Software Engineering
Empirical studies in reverse engineering: state of the art and future trends
Empirical Software Engineering
Systematic review: A systematic review of effect size in software engineering experiments
Information and Software Technology
Controlled experimentation on adaptations of pair programming
Information Technology and Management
Software testing processes as a linear dynamic system
Information Sciences: an International Journal
Journal of the American Society for Information Science and Technology
The role of replications in empirical software engineering--a word of warning
Empirical Software Engineering
Workflow management versus case handling: results from a controlled software experiment
Proceedings of the 2008 ACM symposium on Applied computing
On the difficulty of replicating human subjects studies in software engineering
Proceedings of the 30th international conference on Software engineering
Proceedings of the 2008 international workshop on Models in software engineering
Empirical studies of agile software development: A systematic review
Information and Software Technology
An empirical study on students' ability to comprehend design patterns
Computers & Education
Software engineering article types: An analysis of the literature
Journal of Systems and Software
Strength of evidence in systematic reviews in software engineering
Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
PROFES '08 Proceedings of the 9th international conference on Product-Focused Software Process Improvement
The effect of task order on the maintainability of object-oriented software
Information and Software Technology
Evaluating legacy system migration technologies through empirical studies
Information and Software Technology
Systematic literature reviews in software engineering - A systematic literature review
Information and Software Technology
A systematic review of quasi-experiments in software engineering
Information and Software Technology
Empirical investigation towards the effectiveness of Test First programming
Information and Software Technology
An update to experimental models for validating computer technology
Journal of Systems and Software
Guidelines for conducting and reporting case study research in software engineering
Empirical Software Engineering
Identifier length and limited programmer memory
Science of Computer Programming
Empirical Validation of Measures for UML Class Diagrams: A Meta-Analysis Study
Models in Software Engineering
The effectiveness of pair programming: A meta-analysis
Information and Software Technology
Proceedings of the joint international and annual ERCIM workshops on Principles of software evolution (IWPSE) and software evolution (Evol) workshops
Developing search strategies for detecting relevant experiments
Empirical Software Engineering
Empirical Software Engineering
How to compare program comprehension in FOSD empirically: an experience report
FOSD '09 Proceedings of the First International Workshop on Feature-Oriented Software Development
A systematic review of domain analysis solutions for product lines
Journal of Systems and Software
What's up with software metrics? - A preliminary mapping study
Journal of Systems and Software
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Using differences among replications of software engineering experiments to gain knowledge
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Action research use in software engineering: An initial survey
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
A checklist for integrating student empirical studies with research and teaching goals
Empirical Software Engineering
The usability inspection performance of work-domain experts: An empirical study
Interacting with Computers
Science of Computer Programming
Techniques for empirical validationt
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
Status of empirical research in software engineering
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
The role of controlled experiments working group results
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
Knowledge acquisition in software engineering requires sharing of data and artifacts
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
Data sharing enabling technologies working group results
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
Empirical software engineering: teaching methods and conducting studies
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
ER'07 Proceedings of the 2007 conference on Advances in conceptual modeling: foundations and applications
Systematic literature reviews in software engineering - A tertiary study
Information and Software Technology
Information Sciences: an International Journal
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
Information and Software Technology
Refining the systematic literature review process--two participant-observer case studies
Empirical Software Engineering
Toward credible evaluation of anomaly-based intrusion-detection methods
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Faith, hope, and love: an essay on software science's neglect of human factors
Proceedings of the ACM international conference on Object oriented programming systems languages and applications
Empirical Software Engineering
The role of non-exact replications in software engineering experiments
Empirical Software Engineering
A method for evaluating rigor and industrial relevance of technology evaluations
Empirical Software Engineering
Information and Software Technology
Using grounded theory to study the experience of software development
Empirical Software Engineering
Benefits and barriers of user evaluation in software engineering research
Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications
Systematic literature review of machine learning based software development effort estimation models
Information and Software Technology
Requirements and constructors for tailoring software processes: a systematic literature review
Software Quality Control
Empirical Software Engineering
Empirical Software Engineering
The doctoral symposium at MODELS 2009
MODELS'09 Proceedings of the 2009 international conference on Models in Software Engineering
Reconciling perspectives: A grounded theory of how people manage the process of software development
Journal of Systems and Software
Reference-based search strategies in systematic reviews
EASE'09 Proceedings of the 13th international conference on Evaluation and Assessment in Software Engineering
The value of mapping studies: a participantobserver case study
EASE'10 Proceedings of the 14th international conference on Evaluation and Assessment in Software Engineering
On searching relevant studies in software engineering
EASE'10 Proceedings of the 14th international conference on Evaluation and Assessment in Software Engineering
Flexibility in research designs in empirical software engineering
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
Empirical-WebGen: a web-based environment for the automatic generation of surveys and experiments
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
Systematic mapping studies in software engineering
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
Preliminary results of a study of the completeness and clarity of structured abstracts
EASE'07 Proceedings of the 11th international conference on Evaluation and Assessment in Software Engineering
Information and Software Technology
Does the level of detail of UML models affect the maintainability of source code?
MODELS'11 Proceedings of the 2011th international conference on Models in Software Engineering
A note on rigour and replicability
ACM SIGSOFT Software Engineering Notes
What works for whom, where, when, and why?: on the role of context in empirical software engineering
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement
Empirical validation of a usability inspection method for model-driven Web development
Journal of Systems and Software
A process for managing interaction between experimenters to get useful similar replications
Information and Software Technology
Comparing the usability of grid-bag and constraint-based layouts
Proceedings of the 24th Australian Computer-Human Interaction Conference
ESEML: empirical software engineering modeling language
Proceedings of the 2012 workshop on Domain-specific modeling
The impact of identifier style on effort and comprehension
Empirical Software Engineering
Research Review: A Systematic Literature Review on the Quality of UML Models
Journal of Database Management
A conceptual model to address threats to validity in controlled experiments
Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering
Empirical studies for innovation dissemination: ten years of experience
Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering
An ecological perspective towards the evolution of quantitative studies in software engineering
Proceedings of the 17th International Conference on Evaluation and Assessment in Software Engineering
Heuristic search-based approach for automated test data generation: a survey
International Journal of Bio-Inspired Computation
Does automated white-box test generation really help software testers?
Proceedings of the 2013 International Symposium on Software Testing and Analysis
On the impact of UML analysis models on source-code comprehensibility and modifiability
ACM Transactions on Software Engineering and Methodology (TOSEM)
Information and Software Technology
A systematic review of systematic review process research in software engineering
Information and Software Technology
Considering rigor and relevance when evaluating test driven development: A systematic review
Information and Software Technology
Empirical Software Engineering
Replications of software engineering experiments
Empirical Software Engineering
Hi-index | 0.01 |
The classical method for identifying cause-effect relationships is to conduct controlled experiments. This paper reports upon the present state of how controlled experiments in software engineering are conducted and the extent to which relevant information is reported. Among the 5,453 scientific articles published in 12 leading software engineering journals and conferences in the decade from 1993 to 2002, 103 articles (1.9 percent) reported controlled experiments in which individuals or teams performed one or more software engineering tasks. This survey quantitatively characterizes the topics of the experiments and their subjects (number of subjects, students versus professionals, recruitment, and rewards for participation), tasks (type of task, duration, and type and size of application) and environments (location, development tools). Furthermore, the survey reports on how internal and external validity is addressed and the extent to which experiments are replicated. The gathered data reflects the relevance of software engineering experiments to industrial practice and the scientific maturity of software engineering research.