Experience with Evaluating Human-Assisted Recovery Processes

Authors:
Aaron B. Brown;Leonard Chung;William Kakes;Calvin Ling;David A. Patterson
Affiliations:
University of California, Berkeley;University of California, Berkeley;University of California, Berkeley;University of California, Berkeley;University of California, Berkeley
Venue:
DSN '04 Proceedings of the 2004 International Conference on Dependable Systems and Networks
Year:
2004

Citing 0
Cited 2

Making database systems usable

Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Configuration debugging as search: finding the needle in the haystack

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6

Quantified Score

Hi-index	0.00

Visualization

Abstract

We describe an approach to quantitatively evaluatinghuman-assisted failure-recovery tools and processes in theenvironment of modern Internet- and enterprise-class serversystems. Our approach can quantify the dependabilityimpact of a single recovery system, and also enables comparisonsbetween different recovery approaches. Theapproach combines aspects of dependability benchmarkingwith human user studies, incorporating human participantsin the system evaluations yet still producing typical dependability-related metrics as results. We illustrate our methodology via a case study of a system-wide undo/redo recoverytool for e-mail services; our approach is able to expose thedependability benefits of the tool as well as point out areaswhere its behavior could use improvement.