The growth of software testing
Communications of the ACM
Experimentation in software engineering: an introduction
Experimentation in software engineering: an introduction
Agile Software Development with Scrum
Agile Software Development with Scrum
Test processes in software product evolution: a qualitative survey on the state of practice
Journal of Software Maintenance: Research and Practice - Special issue: Process diversity
Verification and Validation in Industry " A Qualitative Survey on the State of Practice
ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
SWSTE '03 Proceedings of the IEEE International Conference on Software-Science, Technology & Engineering
A Preliminary Survey on Software Testing Practices in Australia
ASWEC '04 Proceedings of the 2004 Australian Software Engineering Conference
A state-of-practice questionnaire on verification and validation for concurrent programs
Proceedings of the 2006 workshop on Parallel and distributed systems: testing and debugging
A Survey of Unit Testing Practices
IEEE Software
ICSE '07 Proceedings of the 29th international conference on Software Engineering
Test driven: practical tdd and acceptance tdd for java developers
Test driven: practical tdd and acceptance tdd for java developers
Guidelines for conducting and reporting case study research in software engineering
Empirical Software Engineering
CSEET '10 Proceedings of the 2010 23rd IEEE Conference on Software Engineering Education and Training
An Open Modern Software Testing Laboratory Courseware - An Experience Report
CSEET '10 Proceedings of the 2010 23rd IEEE Conference on Software Engineering Education and Training
An Industrial Survey on Contemporary Aspects of Software Testing
ICST '10 Proceedings of the 2010 Third International Conference on Software Testing, Verification and Validation
Journal of Systems and Software
How Test Organizations Adopt New Testing Practices and Methods?
ICSTW '11 Proceedings of the 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops
An Analysis and Survey of the Development of Mutation Testing
IEEE Transactions on Software Engineering
CSEET '11 Proceedings of the 2011 24th IEEE-CS Conference on Software Engineering Education and Training
Finding and ranking research directions for software testing
EuroSPI'05 Proceedings of the 12th European conference on Software Process Improvement
A qualitative survey of regression testing practices
PROFES'10 Proceedings of the 11th international conference on Product-Focused Software Process Improvement
ICST '12 Proceedings of the 2012 IEEE Fifth International Conference on Software Testing, Verification and Validation
MODELS'12 Proceedings of the 15th international conference on Model Driven Engineering Languages and Systems
Review: Cloud computing service composition: A systematic literature review
Expert Systems with Applications: An International Journal
Hi-index | 0.00 |
Software testing is an important activity in the software development life-cycle. In an earlier study in 2009, we reported the results of a regional survey of software testing practices among practitioners in the Canadian province of Alberta. To get a larger nationwide view on this topic (across Canada), we conducted a newer survey with a revised list of questions in 2010. Compared to our previous Alberta-wide survey (53 software practitioners), the nation-wide survey had larger number of participants (246 practitioners). We report the survey design, execution and results in this article. The survey results reveal important and interesting findings about software testing practices in Canada. Whenever possible, we also compare the results of this survey to other similar studies, such as the ones conducted in the US, Sweden and Australia, and also two previous Alberta-wide surveys, including our 2009 survey. The results of our survey will be of interest to testing professionals both in Canada and world-wide. It will also benefit researchers in observing the latest trends in software testing industry identifying the areas of strength and weakness, which would then hopefully encourage further industry-academia collaborations in this area. Among the findings are the followings: (1) the importance of testing-related training is increasing, (2) functional and unit testing are two common test types that receive the most attention and efforts spent on them, (3) usage of the mutation testing approach is getting attention among Canadian firms, (4) traditional Test-last Development (TLD) style is still dominating and a few companies are attempting the new development approaches such as Test-Driven Development (TDD), and Behavior-Driven Development (BDD), (5) in terms of the most popular test tools, NUnit and Web application testing tools overtook JUnit and IBM Rational tools, (6) most Canadian companies use a combination of two coverage metrics: decision (branch) and condition coverage, (7) number of passing user acceptance tests and number of defects found per day (week or month) are regarded as the most important quality assurance metrics and decision factors to release, (8) in most Canadian companies, testers are out-numbered by developers, with ratios ranging from 1:2 to 1:5, (9) the majority of Canadian firms spent less than 40% of their efforts (budget and time) on testing during development, and (10) more than 70% of respondents participated in online discussion forums related to testing on a regular basis.