NetPilot: automating datacenter network failure mitigation

  • Authors:

  • Xin Wu;Daniel Turner;Chao-Chih Chen;David A. Maltz;Xiaowei Yang;Lihua Yuan;Ming Zhang

  • Affiliations:

  • Duke University, Durham, NC, USA;University of California, San Diego, San Diego, CA, USA;University of California, Davis, Davis, USA;Microsoft, Bellevue, WA, USA;Duke University, Durham, USA;Microsoft, Bellevue, WA, USA;Microsoft, Redmond, WA, USA

  • Venue:
  • Proceedings of the ACM SIGCOMM 2012 conference on Applications, technologies, architectures, and protocols for computer communication
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Driven by the soaring demands for always-on and fast-response online services, modern datacenter networks have recently undergone tremendous growth. These networks often rely on commodity hardware to reach immense scale while keeping capital expenses under check. The downside is that commodity devices are prone to failures, raising a formidable challenge for network operators to promptly handle these failures with minimal disruptions to the hosted services. Recent research efforts have focused on automatic failure localization. Yet, resolving failures still requires significant human interventions, resulting in prolonged failure recovery time. Unlike previous work, NetPilot aims to quickly mitigate rather than resolve failures. NetPilot mitigates failures in much the same way operators do -- by deactivating or restarting suspected offending components. NetPilot circumvents the need for knowing the exact root cause of a failure by taking an intelligent trial-and-error approach. The core of NetPilot is comprised of an Impact Estimator that helps guard against overly disruptive mitigation actions and a failure-specific mitigation planner that minimizes the number of trials. We demonstrate that NetPilot can effectively mitigate several types of critical failures commonly encountered in production datacenter networks.