Industrial Evaluation of a Log File Analysis Methodology

Authors:
Donald J. Yantzi;James H. Andrews
Affiliations:
IBM Toronto Laboratory, Markham, Ontario, Canada;University of Western Ontario
Venue:
WODA '07 Proceedings of the 5th International Workshop on Dynamic Analysis
Year:
2007

Citing 5
Cited 0

Specification-based test oracles for reactive systems

ICSE '92 Proceedings of the 14th international conference on Software engineering
Design patterns: elements of reusable object-oriented software

Design patterns: elements of reusable object-oriented software
The ASTOOT approach to testing object-oriented programs

ACM Transactions on Software Engineering and Methodology (TOSEM)
Using Test Oracles Generated from Program Documentation

IEEE Transactions on Software Engineering
General Test Result Checking with Log File Analysis

IEEE Transactions on Software Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

Test result evaluation programs often take the form of log file analyzers, which analyze text logs of events that have happened during testing. Previously, we proposed a methodology for deriving logging instrumentation and state-based log file analyzer programs from requirements. In this paper, we report on an industrial evaluation in which the methodology was carried out on two pieces of commercial software in a commercial setting. We report on our quantitative and qualitative observations and on recommendations for improving the methodology and the tools used.