How do testers do it? An exploratory study on manual testing practices

Authors:
Juha Itkonen;Mika V. Mantyla;Casper Lassenius
Affiliations:
Helsinki University of Technology, Software Business and Engineering Institute, P.O. Box 9210, FI-02015 TKK, Finland;Helsinki University of Technology, Software Business and Engineering Institute, P.O. Box 9210, FI-02015 TKK, Finland;Helsinki University of Technology, Software Business and Engineering Institute, P.O. Box 9210, FI-02015 TKK, Finland
Venue:
ESEM '09 Proceedings of the 2009 3rd International Symposium on Empirical Software Engineering and Measurement
Year:
2009

Citing 12
Cited 2

Software testing techniques (2nd ed.)

Software testing techniques (2nd ed.)
Art of Software Testing

Art of Software Testing
Lessons Learned in Software Testing

Lessons Learned in Software Testing
Managing high-speed web testing

Software quality and software testing in internet times
Verification and Validation in Industry " A Qualitative Survey on the State of Practice

ISESE '02 Proceedings of the 2002 International Symposium on Empirical Software Engineering
Reviewing 25 Years of Testing Technique Experiments

Empirical Software Engineering
Impacts of the Organizational Model on Testing: Three Industrial Cases

Empirical Software Engineering
Observations and lessons learned from automated testing

Proceedings of the 27th international conference on Software engineering
'Good' Organisational Reasons for 'Bad' Software Testing: An Ethnographic Study of Testing in a Small Software Company

ICSE '07 Proceedings of the 29th international conference on Software Engineering
Defect Detection Efficiency: Test Case Based vs. Exploratory Testing

ESEM '07 Proceedings of the First International Symposium on Empirical Software Engineering and Measurement
The Role of Experience in Software Testing Practice

SEAA '08 Proceedings of the 2008 34th Euromicro Conference Software Engineering and Advanced Applications
A Look at 25 Years of Data

IEEE Software

Who tested my software? Testing as an organizationally cross-cutting activity

Software Quality Control
Are test cases needed? Replicated comparison between exploratory and test-case-based software testing

Empirical Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present the results of a qualitative observation study on the manual testing practices in four software development companies. Manual testing practices are seldom studied, and based on the literature we conjecture that they have a strong effect on the effectiveness of manual testing. We observed testing sessions of 11 software professionals performing system level functional testing. As a result we identified 22 manual testing practices that we classified into 9 test session strategies and 13 detailed test execution techniques. Many of the identified techniques were based on similar ideas as traditional test case design techniques. However, the subjects applied these techniques during manual testing without separate test design phase. The results indicate that software professionals use a wide set of strategies and techniques when performing manual testing. Testers seem to need and use techniques even if applying exploratory testing.