Experimentation in software engineering
IEEE Transactions on Software Engineering
Experimental evaluation in computer science: a quantitative study
Journal of Systems and Software
Experimental design and analysis in software engineering, part 5: analyzing the data
ACM SIGSOFT Software Engineering Notes
Pilot studies: what, why, and how
Journal of Systems and Software
Evaluating software engineering methods and tools part 12: evaluating DESMET
ACM SIGSOFT Software Engineering Notes
Empirical research in information systems: the practice of relevance
MIS Quarterly - Special issue on intensive research in information systems
Software technology maturation
ICSE '85 Proceedings of the 8th international conference on Software engineering
Understanding and improving technology transfer in software engineering
Journal of Systems and Software - Special issue on invited articles on top systems and software engineering scholars
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
Empirical studies of software engineering: a roadmap
Proceedings of the Conference on The Future of Software Engineering
Empirical Software Engineering
Software-Engineering Research Revisited
IEEE Software
Status Report: Requirements Engineering
IEEE Software
IEEE Software
Marketing Technology to Software Practitioners
IEEE Software
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
Principles of survey research part 6: data analysis
ACM SIGSOFT Software Engineering Notes
Requirements Engineering and Industrial Uptake
ICRE '98 Proceedings of the 3rd International Conference on Requirements Engineering: Putting Requirements Engineering to Practice
Conducting Realistic Experiments in Software Engineering
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
Requirements Engineering: The State of the Practice
IEEE Software
IEEE Transactions on Software Engineering
An operational model for structuring the requirements generation process
Requirements Engineering
Using an expert panel to validate a requirements process improvement model
Journal of Systems and Software
A Survey of Controlled Experiments in Software Engineering
IEEE Transactions on Software Engineering
Generating requirements from systems models using patterns: a case study
Requirements Engineering
Applying a pragmatics-based creativity-fostering technique to requirements elicitation
Requirements Engineering
On the success of empirical studies in the international conference on software engineering
Proceedings of the 28th international conference on Software engineering
Experiences from introducing UML-based development in a large safety-critical project
Empirical Software Engineering
A Model for Technology Transfer in Practice
IEEE Software
The Future of Empirical Methods in Software Engineering Research
FOSE '07 2007 Future of Software Engineering
A Systematic Review of Theory Use in Software Engineering Experiments
IEEE Transactions on Software Engineering
Evaluating Pair Programming with Respect to System Complexity and Programmer Expertise
IEEE Transactions on Software Engineering
Systematic review: A systematic review of effect size in software engineering experiments
Information and Software Technology
Communications of the ACM
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Applying Systematic Reviews to Diverse Study Types: An Experience Report
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Structured Analysis for Requirements Definition
IEEE Transactions on Software Engineering
User-Perceived Quality of Interactive Systems
IEEE Transactions on Software Engineering
Requirements engineering: In search of the dependent variables
Information and Software Technology
Industry evaluation of the Requirements Abstraction Model
Requirements Engineering
An analysis of the most cited articles in software engineering journals - 2002
Information and Software Technology
Viewpoint: Research evaluation for computer science
Communications of the ACM - A Direct Path to Dependable Software
An update to experimental models for validating computer technology
Journal of Systems and Software
A systematic review of search-based testing for non-functional system properties
Information and Software Technology
Guidelines for conducting and reporting case study research in software engineering
Empirical Software Engineering
Generic Skills in Software Engineering Master Thesis Projects: Towards Rubric-Based Evaluation
CSEET '09 Proceedings of the 2009 22nd Conference on Software Engineering Education and Training
Journal of Systems and Software
A systematic review of domain analysis solutions for product lines
Journal of Systems and Software
Context in industrial software engineering research
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Empirical evidence in global software engineering: a systematic review
Empirical Software Engineering
Status of empirical research in software engineering
Proceedings of the 2006 international conference on Empirical software engineering issues: critical assessment and future directions
Systematic mapping studies in software engineering
EASE'08 Proceedings of the 12th international conference on Evaluation and Assessment in Software Engineering
Measuring and predicting software productivity: A systematic map and review
Information and Software Technology
Software quality trade-offs: A systematic map
Information and Software Technology
Reducing test effort: A systematic mapping study on existing approaches
Information and Software Technology
Systematic literature studies: database searches vs. backward snowballing
Proceedings of the ACM-IEEE international symposium on Empirical software engineering and measurement
Equality in cumulative voting: A systematic review with an improvement proposal
Information and Software Technology
Variability in quality attributes of service-based software systems: A systematic literature review
Information and Software Technology
A taxonomy for requirements engineering and software test alignment
ACM Transactions on Software Engineering and Methodology (TOSEM)
The lean gap: A review of lean approaches to large-scale software systems development
Journal of Systems and Software
Considering rigor and relevance when evaluating test driven development: A systematic review
Information and Software Technology
Hi-index | 0.00 |
One of the main goals of an applied research field such as software engineering is the transfer and widespread use of research results in industry. To impact industry, researchers developing technologies in academia need to provide tangible evidence of the advantages of using them. This can be done trough step-wise validation, enabling researchers to gradually test and evaluate technologies to finally try them in real settings with real users and applications. The evidence obtained, together with detailed information on how the validation was conducted, offers rich decision support material for industry practitioners seeking to adopt new technologies and researchers looking for an empirical basis on which to build new or refined technologies. This paper presents model for evaluating the rigor and industrial relevance of technology evaluations in software engineering. The model is applied and validated in a comprehensive systematic literature review of evaluations of requirements engineering technologies published in software engineering journals. The aim is to show the applicability of the model and to characterize how evaluations are carried out and reported to evaluate the state-of-research. The review shows that the model can be applied to characterize evaluations in requirements engineering. The findings from applying the model also show that the majority of technology evaluations in requirements engineering lack both industrial relevance and rigor. In addition, the research field does not show any improvements in terms of industrial relevance over time.