Policity: An Experimental Evaluation of Policy-Based Administration in a City Simulation

  • Authors:
  • Christopher S. Campbell;Eser Kandogan;Adam November;Rob Barrett;Paul P. Maglio

  • Affiliations:
  • IBM Almaden Research Center;IBM Almaden Research Center;Stanford University;IBM Almaden Research Center;IBM Almaden Research Center

  • Venue:
  • POLICY '05 Proceedings of the Sixth IEEE International Workshop on Policies for Distributed Systems and Networks
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

The administration cost of todayýs complex IT systems is a major inhibitor of growth for many companies in the burgeoning services economy. One proposed solution is policy-based system administration---a type of autonomic computing system that can manage itself with minimum human intervention. To explore the cost-benefit tradeoffs of policy-based system administration, we conducted an experiment in which participants managed a simulated city (Policity) using either a policy-based interface or a manual GUI-based interface. Results showed that for novices, performance was 50% higher using the policy interface compared to using the manual interface, but the interaction workload was significantly higher with the policy interface than with the manual interface. Overall, our results suggest that policy-based system administration can provide substantial productivity improvement at the cost of some additional interaction workload.