Experimentation in software engineering
IEEE Transactions on Software Engineering
Science and Substance: A Challenge to Software Engineers
IEEE Software
Design and use of software architectures: adopting and evolving a product-line approach
Design and use of software architectures: adopting and evolving a product-line approach
Software product lines: a case study
Software—Practice & Experience
Domain-oriented engineering of elevator control software: a product line practice
Proceedings of the first conference on Software product lines : experience and research directions: experience and research directions
Managing variability in software architectures
SSR '01 Proceedings of the 2001 symposium on Software reusability: putting software reuse in context
Achieving extensibility through product-lines and domain-specific languages: a case study
ACM Transactions on Software Engineering and Methodology (TOSEM)
FORM: A feature-oriented reuse method with domain-specific reference architectures
Annals of Software Engineering
Preliminary guidelines for empirical research in software engineering
IEEE Transactions on Software Engineering
Model-Driven Product Line Architectures
SPLC 2 Proceedings of the Second International Conference on Software Product Lines
Variation Management for Software Production Lines
SPLC 2 Proceedings of the Second International Conference on Software Product Lines
Variability Issues in Software Product Lines
PFE '01 Revised Papers from the 4th International Workshop on Software Product-Family Engineering
Writing good software engineering research papers: minitutorial
Proceedings of the 25th International Conference on Software Engineering
Generating Product-Lines of Product-Families
Proceedings of the 17th IEEE international conference on Automated software engineering
On the Notion of Variability in Software Product Lines
WICSA '01 Proceedings of the Working IEEE/IFIP Conference on Software Architecture
Evidence-Based Software Engineering
Proceedings of the 26th International Conference on Software Engineering
Evidence-Based Software Engineering for Practitioners
IEEE Software
A customizable approach to full lifecycle variability management
Science of Computer Programming - Special issue: Software variability management
Variability management with feature models
Science of Computer Programming - Special issue: Software variability management
A taxonomy of variability realization techniques: Research Articles
Software—Practice & Experience
Reuse and variability in large software applications
Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering
Industrial experience with building a web portal product line using a lightweight, reactive approach
Proceedings of the 10th European software engineering conference held jointly with 13th ACM SIGSOFT international symposium on Foundations of software engineering
IEEE Transactions on Software Engineering
Software Product Line Engineering: Foundations, Principles and Techniques
Software Product Line Engineering: Foundations, Principles and Techniques
A variability management process for software product lines
CASCON '05 Proceedings of the 2005 conference of the Centre for Advanced Studies on Collaborative research
Architecturally Reconfigurable Development of Mobile Games
ICESS '05 Proceedings of the Second International Conference on Embedded Software and Systems
On the success of empirical studies in the international conference on software engineering
Proceedings of the 28th international conference on Software engineering
Testing and inspecting reusable product line components: first empirical results
Proceedings of the 2006 ACM/IEEE international symposium on Empirical software engineering
Kumbang: A domain ontology for modelling variability in software product families
Advanced Engineering Informatics
Journal of Systems and Software
Classifying variability modeling techniques
Information and Software Technology
Cross versus Within-Company Cost Estimation Studies: A Systematic Review
IEEE Transactions on Software Engineering
Software Product Lines in Action: The Best Industrial Practice in Product Line Engineering
Software Product Lines in Action: The Best Industrial Practice in Product Line Engineering
Applying Systematic Reviews to Diverse Study Types: An Experience Report
ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
Optimization of Variability in Software Product Lines
SPLC '07 Proceedings of the 11th International Software Product Line Conference
Industrial validation of COVAMOF
Journal of Systems and Software
Empirical studies of agile software development: A systematic review
Information and Software Technology
Strength of evidence in systematic reviews in software engineering
Proceedings of the Second ACM-IEEE international symposium on Empirical software engineering and measurement
A systematic review of quasi-experiments in software engineering
Information and Software Technology
Guidelines for conducting and reporting case study research in software engineering
Empirical Software Engineering
Variability management in software product lines: a systematic review
Proceedings of the 13th International Software Product Line Conference
Integration testing in software product line engineering: a model-based technique
FASE'07 Proceedings of the 10th international conference on Fundamental approaches to software engineering
Managing Variability in Software Product Lines
IEEE Software
Model-based system testing of software product families
CAiSE'05 Proceedings of the 17th international conference on Advanced Information Systems Engineering
The COVAMOF derivation process
ICSR'06 Proceedings of the 9th international conference on Reuse of Off-the-Shelf Components
A status report on the evaluation of variability management approaches
EASE'09 Proceedings of the 13th international conference on Evaluation and Assessment in Software Engineering
Proceedings of the 15th International Software Product Line Conference, Volume 2
Feature modeling tools: evaluation and lessons learned
ER'11 Proceedings of the 30th international conference on Advances in conceptual modeling: recent developments and new directions
A user survey of configuration challenges in Linux and eCos
Proceedings of the Sixth International Workshop on Variability Modeling of Software-Intensive Systems
Cool features and tough decisions: a comparison of variability modeling approaches
Proceedings of the Sixth International Workshop on Variability Modeling of Software-Intensive Systems
A systematic review and an expert survey on capabilities supporting multi product lines
Information and Software Technology
Evaluation of the Pattern-based method for Secure Development (PbSD): A controlled experiment
Information and Software Technology
Generating range fixes for software configuration
Proceedings of the 34th International Conference on Software Engineering
Towards a reasoning framework for software product line testing
Proceedings of the 16th International Software Product Line Conference - Volume 2
Variability modeling in the wild
Proceedings of the 16th International Software Product Line Conference - Volume 2
Variability in quality attributes of service-based software systems: A systematic literature review
Information and Software Technology
Using CVL to operationalize product line development with reusable aspect models
Proceedings of the VARiability for You Workshop: Variability Modeling Made Useful for Everyone
A survey of variability modeling in industrial practice
Proceedings of the Seventh International Workshop on Variability Modelling of Software-intensive Systems
SMartyParser: a XMI parser for UML-based software product line variability models
Proceedings of the Seventh International Workshop on Variability Modelling of Software-intensive Systems
A mapping study to investigate component-based software system metrics
Journal of Systems and Software
Towards systematic software reuse of GIS: Insights from a case study
Computers & Geosciences
FAMILIAR: A domain-specific language for large scale management of feature models
Science of Computer Programming
A mixed-method approach for the empirical evaluation of the issue-based variability modeling
Journal of Systems and Software
Flexible development of variable software features for mobile business applications
Proceedings of the 17th International Software Product Line Conference co-located workshops
Web Semantics: Science, Services and Agents on the World Wide Web
A survey on teaching of software product lines
Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems
Towards system analysis with variability model metrics
Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems
Hi-index | 0.00 |
Context: Variability management (VM) is one of the most important activities of software product-line engineering (SPLE), which intends to develop software-intensive systems using platforms and mass customization. VM encompasses the activities of eliciting and representing variability in software artefacts, establishing and managing dependencies among different variabilities, and supporting the exploitation of the variabilities for building and evolving a family of software systems. Software product line (SPL) community has allocated huge amount of effort to develop various approaches to dealing with variability related challenges during the last two decade. Several dozens of VM approaches have been reported. However, there has been no systematic effort to study how the reported VM approaches have been evaluated. Objective: The objectives of this research are to review the status of evaluation of reported VM approaches and to synthesize the available evidence about the effects of the reported approaches. Method: We carried out a systematic literature review of the VM approaches in SPLE reported from 1990s until December 2007. Results: We selected 97 papers according to our inclusion and exclusion criteria. The selected papers appeared in 56 publication venues. We found that only a small number of the reviewed approaches had been evaluated using rigorous scientific methods. A detailed investigation of the reviewed studies employing empirical research methods revealed significant quality deficiencies in various aspects of the used quality assessment criteria. The synthesis of the available evidence showed that all studies, except one, reported only positive effects. Conclusion: The findings from this systematic review show that a large majority of the reported VM approaches have not been sufficiently evaluated using scientifically rigorous methods. The available evidence is sparse and the quality of the presented evidence is quite low. The findings highlight the areas in need of improvement, i.e., rigorous evaluation of VM approaches. However, the reported evidence is quite consistent across different studies. That means the proposed approaches may be very beneficial when they are applied properly in appropriate situations. Hence, it can be concluded that further investigations need to pay more attention to the contexts under which different approaches can be more beneficial.