Scaling a monitoring infrastructure for the Akamai network

  • Authors:
  • Thomas Repantis;Jeff Cohen;Scott Smith;Joel Wein

  • Affiliations:
  • Akamai Technologies, Cambridge, MA;Akamai Technologies, Cambridge, MA;Clustrix, Inc., San Francisco, CA;Akamai Technologies, Cambridge, MA

  • Venue:
  • ACM SIGOPS Operating Systems Review
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We describe the design of, and experience with, Query, a monitoring system that supports the Akamai EdgePlatform. Query is a foundation of Akamai's approach to administering its distributed computing platform, allowing administrators, operations staff, developers, customers, and automated systems near real-time access to data about activity in Akamai's network. Users extract information regarding the current state of the network via a SQL-like interface. Versions of Query have been deployed since the inception of Akamai's platform, and it has scaled to support a distributed platform of 60,000+ servers, collecting over 200 gigabytes of data and answering over 30,000 queries approximately every 2 minutes.