Efficiently Extracting Operational Profiles from Execution Logs Using Suffix Arrays

Authors:
Meiyappan Nagappan;Kesheng Wu;Mladen A. Vouk
Affiliations:
-;-;-
Venue:
ISSRE '09 Proceedings of the 2009 20th International Symposium on Software Reliability Engineering
Year:
2009

Citing 0
Cited 3

Analysis of execution log files

Proceedings of the 32nd ACM/IEEE International Conference on Software Engineering - Volume 2
Creating operational profiles of software systems by transforming their log files to directed cyclic graphs

Proceedings of the 6th International Workshop on Traceability in Emerging Forms of Software Engineering
Adapting system execution traces to support analysis of software system performance properties

Journal of Systems and Software

Quantified Score

Hi-index	0.01

Visualization

Abstract

An important software reliability engineering tool is operational profiles. In this paper we propose a cost effective automated approach for creating second generation operational profiles using execution logs of a software product. Our algorithm parses the execution logs into sequences of events and produces an ordered list of all possible subsequences by constructing a suffix-array of the events. The difficulty in using execution logs is that the amount of data that needs to be analyzed is often extremely large (more than a million records per day in many applications). Our approach is very efficient. We show that our approach requires O(N) in space and time to discover all possible patterns in N events. We discuss a practical implementation of the algorithm in the context of the logs from a large cloud computing system.