Automated experiment-driven management of (database) systems

Authors:
Shivnath Babu;Nedyalko Borisov;Songyun Duan;Herodotos Herodotou;Vamsidhar Thummala
Affiliations:
Duke University;Duke University;Duke University;Duke University;Duke University
Venue:
HotOS'09 Proceedings of the 12th conference on Hot topics in operating systems
Year:
2009

Citing 7
Cited 8

Using probabilistic reasoning to automate software tuning

Using probabilistic reasoning to automate software tuning
Three research challenges at the intersection of machine learning, statistical induction, and systems

HOTOS'05 Proceedings of the 10th conference on Hot Topics in Operating Systems - Volume 10
Correlating instrumentation data to system states: a building block for automated diagnosis and control

OSDI'04 Proceedings of the 6th conference on Symposium on Opearting Systems Design & Implementation - Volume 6
Self-tuning database technology and information services: from wishful thinking to viable engineering

VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Cutting corners: workbench automation for server benchmarking

ATC'08 USENIX 2008 Annual Technical Conference on Annual Technical Conference
Modeling and exploiting query interactions in database systems

Proceedings of the 17th ACM conference on Information and knowledge management
Active and accelerated learning of cost models for optimizing scientific applications

VLDB '06 Proceedings of the 32nd international conference on Very large data bases

Automatic exploration of datacenter performance regimes

ACDC '09 Proceedings of the 1st workshop on Automated control for datacenters and clouds
Large-scale uncertainty management systems: learning and exploiting your data

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Automated SQL tuning through trial and (sometimes) error

Proceedings of the Second International Workshop on Testing Database Systems
Towards automatic optimization of MapReduce programs

Proceedings of the 1st ACM symposium on Cloud computing
iTuned: a tool for configuring and visualizing database parameters

Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
Reflective control for an elastic cloud application: an automated experiment workbench

HotCloud'09 Proceedings of the 2009 conference on Hot topics in cloud computing
Predicting completion times of batch query workloads using interaction-aware models and simulation

Proceedings of the 14th International Conference on Extending Database Technology
Interaction-aware scheduling of report-generation workloads

The VLDB Journal — The International Journal on Very Large Data Bases

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this position paper, we argue that an important piece of the system administration puzzle has largely been left untouched by researchers. This piece involves mechanisms and policies to identify as well as collect missing instrumentation data; the missing data is essential to generate the knowledge required to address certain administrative tasks satisfactorily and efficiently. We introduce the paradigm of experiment-driven management which encapsulates such mechanisms and policies for a given administrative task. We outline the benefits that automated experiment-driven management brings to several long-standing problems in databases as well as other systems, and identify research challenges as well as initial solutions.