A qualitative survey of regression testing practices

Authors:
Emelie Engström;Per Runeson
Affiliations:
Department of Computer Science, Lund University, LUND, Sweden;Department of Computer Science, Lund University, LUND, Sweden
Venue:
PROFES'10 Proceedings of the 11th international conference on Product-Focused Software Process Improvement
Year:
2010

Citing 12
Cited 7

A framework for information systems architecture

IBM Systems Journal
Regression testing in an industrial environment

Communications of the ACM
Test processes in software product evolution: a qualitative survey on the state of practice

Journal of Software Maintenance: Research and Practice - Special issue: Process diversity
Industrial Real-Time Regression Testing and Analysis Using Firewalls

ICSM '04 Proceedings of the 20th IEEE International Conference on Software Maintenance
On the Testing Maturity of Software Producing Organizations

TAIC-PART '06 Proceedings of the Testing: Academic & Industrial Conference on Practice And Research Techniques
A Survey of Unit Testing Practices

IEEE Software
Guidelines for conducting and reporting case study research in software engineering

Empirical Software Engineering
Recomputing Coverage Information to Assist Regression Testing

IEEE Transactions on Software Engineering
A systematic review on regression test selection techniques

Information and Software Technology
Testing in the Wild: The Social and Organisational Dimensions of Real World Practice

Computer Supported Cooperative Work
An Empirical Evaluation of Regression Testing Based on Fix-Cache Recommendations

ICST '10 Proceedings of the 2010 Third International Conference on Software Testing, Verification and Validation
An Industrial Survey on Contemporary Aspects of Software Testing

ICST '10 Proceedings of the 2010 Third International Conference on Software Testing, Verification and Validation

Usage of open source in commercial software product development - findings from a focus group meeting

PROFES'11 Proceedings of the 12th international conference on Product-focused software process improvement
Evolutionary testing of autonomous software agents

Autonomous Agents and Multi-Agent Systems
Indirect effects in evidential assessment: a case study on regression test technology adoption

Proceedings of the 2nd international workshop on Evidential assessment of software technologies
Test overlay in an emerging software product line - An industrial case study

Information and Software Technology
A survey of software testing practices in Canada

Journal of Systems and Software
Recovering test-to-code traceability using slicing and textual analysis

Journal of Systems and Software
Are test cases needed? Replicated comparison between exploratory and test-case-based software testing

Empirical Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

Aim: Regression testing practices in industry have to be better understood, both for the industry itself and for the research community. Method: We conducted a qualitative industry survey by i) running a focus group meeting with 15 industry participants and ii) validating the outcome in an on line questionnaire with 32 respondents. Results: Regression testing needs and practices vary greatly between and within organizations and at different stages of a project. The importance and challenges of automation is clear from the survey. Conclusions: Most of the findings are general testing issues and are not specific to regression testing. Challenges and good practices relate to test automation and testability issues.