Elastic online analytical processing on RAMCloud

  • Authors:
  • Christian Tinnefeld;Donald Kossmann;Martin Grund;Joos-Hendrik Boese;Frank Renkes;Vishal Sikka;Hasso Plattner

  • Affiliations:
  • University of Potsdam, Germany;Systems Group, ETH Zurich, Switzerland;University of Potsdam, Germany;SAP AG, Walldorf, Germany;SAP AG, Walldorf, Germany;SAP AG, Walldorf, Germany;University of Potsdam, Germany

  • Venue:
  • Proceedings of the 16th International Conference on Extending Database Technology
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

A shared-nothing architecture is state-of-the-art for deploying a distributed analytical in-memory database management system: it preserves the in-memory performance advantage by processing data locally on each node but is difficult to scale out. Modern switched fabric communication links such as InfiniBand narrow the performance gap between local and remote DRAM data access to a single order of magnitude. Based on these premises, we introduce a distributed in-memory database architecture that separates the query execution engine and data access: this enables a) the usage of a large-scale DRAM-based storage system such as Stanford's RAMCloud and b) the push-down of bandwidth-intensive database operators into the storage system. We address the resulting challenges such as finding the optimal operator execution strategy and partitioning scheme. We demonstrate that such an architecture delivers both: the elasticity of a shared-storage approach and the performance characteristics of operating on local DRAM.