Scaling up analytical queries with column-stores

Authors:
Ioannis Alagiannis;Manos Athanassoulis;Anastasia Ailamaki
Affiliations:
Ecole Polytechnique Fédérale de Lausanne, Lausanne, VD, Switzerland;Ecole Polytechnique Fédérale de Lausanne, Lausanne, VD, Switzerland;Ecole Polytechnique Fédérale de Lausanne, Lausanne, VD, Switzerland
Venue:
Proceedings of the Sixth International Workshop on Testing Database Systems
Year:
2013

Citing 21
Cited 0

Multiple-query optimization

ACM Transactions on Database Systems (TODS)
Measuring parallel processor performance

Communications of the ACM
View indexing in relational databases

ACM Transactions on Database Systems (TODS)
Efficient and extensible algorithms for multi query optimization

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Common expression analysis in database applications

SIGMOD '82 Proceedings of the 1982 ACM SIGMOD international conference on Management of data
Redbrick Vista: Aggregate Computation and Management

ICDE '98 Proceedings of the Fourteenth International Conference on Data Engineering
Dynamic Caching of Query Results for Decision Support Systems

SSDBM '99 Proceedings of the 11th International Conference on Scientific and Statistical Database Management
QPipe: a simultaneously pipelined relational query engine

Proceedings of the 2005 ACM SIGMOD international conference on Management of data
C-store: a column-oriented DBMS

VLDB '05 Proceedings of the 31st international conference on Very large data bases
Cooperative scans: dynamic bandwidth sharing in a DBMS

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Main-memory scan sharing for multi-core CPUs

Proceedings of the VLDB Endowment
Shore-MT: a scalable storage manager for the multicore era

Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
An architecture for recycling intermediates in a column-store

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Data warehouse technology by infobright

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
A scalable, predictable join operator for highly concurrent data warehouses

Proceedings of the VLDB Endowment
Predictable performance for unpredictable workloads

Proceedings of the VLDB Endowment
The DataPath system: a data-centric analytic processing engine for large data warehouses

Proceedings of the 2010 ACM SIGMOD International Conference on Management of data
MaSM: efficient online updates in data warehouses

Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
SharedDB: killing one thousand queries with one stone

Proceedings of the VLDB Endowment
Concurrency control for adaptive indexing

Proceedings of the VLDB Endowment
The vertica analytic database: C-store 7 years later

Proceedings of the VLDB Endowment

Quantified Score

Hi-index	0.00

Visualization

Abstract

As data analytics is used by an increasing number of applications, data analytics engines are required to execute workloads with increased concurrency, i.e., an increasing number of clients submitting queries. Data management systems designed for data analytics - a market dominated by column-stores - however, were initially optimized for single query execution, minimizing its response time. Hence, they do not treat concurrency as a first class citizen. In this paper, we experiment with one open-source and two commercial column-stores using the TPC-H and SSB benchmarks in a setup with an increasing number of concurrent clients submitting queries, focusing on whether the tested systems can scale up in a single node instance. The tested systems for in-memory workloads scale up, to some degree; however, when the server is saturated they fail to fully exploit the available parallelism. Further, we highlight the unpredictable response times for high concurrency.