Performance debugging in data centers: doing more with less

Authors:
Emmanuel Cecchet;Maitreya Natu;Vaishali Sadaphal;Prashant Shenoy;Harrick Vin
Affiliations:
Computer Science Department, University of Massachusetts at Amherst;Tata Research Development and Design Centre, Tata Consultancy Services, Pune, India;Tata Research Development and Design Centre, Tata Consultancy Services, Pune, India;Computer Science Department, University of Massachusetts at Amherst;Tata Research Development and Design Centre, Tata Consultancy Services, Pune, India
Venue:
COMSNETS'09 Proceedings of the First international conference on COMmunication Systems And NETworks
Year:
2009

Citing 10
Cited 0

Learning Bayesian Networks: The Combination of Knowledge and Statistical Data

Machine Learning
Network tomography on general topologies

SIGMETRICS '02 Proceedings of the 2002 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Pinpoint: Problem Determination in Large, Dynamic Internet Services

DSN '02 Proceedings of the 2002 International Conference on Dependable Systems and Networks
Performance debugging for distributed systems of black boxes

SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Failure Diagnosis Using Decision Trees

ICAC '04 Proceedings of the First International Conference on Autonomic Computing
Magpie: online modelling and performance-aware systems

HOTOS'03 Proceedings of the 9th conference on Hot Topics in Operating Systems - Volume 9
Correlating instrumentation data to system states: a building block for automated diagnosis and control

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Towards highly reliable enterprise network services via inference of multi-level dependencies

Proceedings of the 2007 conference on Applications, technologies, architectures, and protocols for computer communications
Ironmodel: robust performance models in the wild
Automating network application dependency discovery: experiences, limitations, and new solutions

OSDI'08 Proceedings of the 8th USENIX conference on Operating systems design and implementation

Quantified Score

Hi-index	0.01

Visualization

Abstract

With the increasing scale and complexity of data centers, detecting and localizing performance faults in real-time has become both a pressing need and a challenge. While several approaches for performance debugging in data centers have been proposed, these techniques do not assume any constraints on the availability of operational data needed to detect and localize faults. We argue that collecting such operational data often requires significant instrumentation or intrusiveness, which is difficult to realize in production data centers. Such constraints complicate the deployment of existing techniques or limit their effectiveness in practice. In this paper, we argue that for performance debugging to become practical and effective in real-world systems, one needs to develop techniques that are "more effective" with "less instrumentation and intrusiveness". We raise several issues and challenges in realizing this vision and present some initial ideas on addressing these challenges.