Combining Visualization and Statistical Analysis to Improve Operator Confidence and Efficiency for Failure Detection and Localization

  • Authors:
  • Peter Bodic;Greg Friedman;Lukas Biewald;Helen Levine;George Candea;Kayur Patel;Gilman Tolle;Jon Hui;Armando Fox;Michael I. Jordan;David Patterson

  • Affiliations:
  • UC Berkeley;Stanford University;Stanford University;Ebates.com;Stanford University;Stanford University;UC Berkeley;UC Berkeley;Stanford University;UC Berkeley;UC Berkeley

  • Venue:
  • ICAC '05 Proceedings of the Second International Conference on Automatic Computing
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Web applications suffer from software and configuration faults that lower their availability. Recovering from failure is dominated by the time interval between when these faults appear and when they are detected by site operators. We introduce a set of tools that augment the ability of operators to perceive the presence of failure: an automatic anomaly detector scours HTTP access logs to find changes in user behavior that are indicative of site failures, and a visualizer helps operators rapidly detect and diagnose problems. Visualization addresses a key question of autonomic computing of how to win operatorsý confidence so that new tools will be embraced. Evaluation performed using HTTP logs from Ebates.com demonstrates that these tools can enhance the detection of failure as well as shorten detection time. Our approach is application-generic and can be applied to any Web application without the need for instrumentation.