EDBT '94 Proceedings of the 4th international conference on extending database technology: Advances in database technology
Efficient and extensible algorithms for multi query optimization
SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Materialized view selection and maintenance using multi-query optimization
SIGMOD '01 Proceedings of the 2001 ACM SIGMOD international conference on Management of data
Optimizing queries using materialized views: a practical, scalable solution
SIGMOD '01 Proceedings of the 2001 ACM SIGMOD international conference on Management of data
A case for dynamic view management
ACM Transactions on Database Systems (TODS)
The SDSS skyserver: public access to the sloan digital sky server data
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Volcano An Extensible and Parallel Query Evaluation System
IEEE Transactions on Knowledge and Data Engineering
Cache-on-Demand: Recycling with Certainty
Proceedings of the 17th International Conference on Data Engineering
Automated Selection of Materialized Views and Indexes in SQL Databases
VLDB '00 Proceedings of the 26th International Conference on Very Large Data Bases
MTCache: Transparent Mid-Tier Database Caching in SQL Server
ICDE '04 Proceedings of the 20th International Conference on Data Engineering
Super-Scalar RAM-CPU Cache Compression
ICDE '06 Proceedings of the 22nd International Conference on Data Engineering
Efficient exploitation of similar subexpressions for query processing
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
MonetDB/SQL Meets SkyServer: the Challenges of a Scientific Database
SSDBM '07 Proceedings of the 19th International Conference on Scientific and Statistical Database Management
Physical design refinement: The ‘merge-reduce’ approach
ACM Transactions on Database Systems (TODS)
Flexible and efficient IR using array databases
The VLDB Journal — The International Journal on Very Large Data Bases
Self-organizing strategies for a column-store database
EDBT '08 Proceedings of the 11th international conference on Extending database technology: Advances in database technology
Breaking the memory wall in MonetDB
Communications of the ACM - Surviving the data deluge
Content-based filtering for efficient online materialized view maintenance
Proceedings of the 17th ACM conference on Information and knowledge management
Dynamic Materialization of Query Views for Data Warehouse Workloads
ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
Dynamic materialized view management based on predicates
APWeb'03 Proceedings of the 5th Asia-Pacific web conference on Web technologies and applications
Database architecture evolution: mammals flourished long before dinosaurs became extinct
Proceedings of the VLDB Endowment
Probabilistic ranking over relations
Proceedings of the 13th International Conference on Extending Database Technology
Parallel programming framework for large batch transaction processing on scale-out systems
Proceedings of the 3rd Annual Haifa Experimental Systems Conference
An architecture for recycling intermediates in a column-store
ACM Transactions on Database Systems (TODS)
Predictable performance and high query concurrency for data analytics
The VLDB Journal — The International Journal on Very Large Data Bases
GBASE: a scalable and general graph management system
Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining
The data cyclotron query processing scheme
ACM Transactions on Database Systems (TODS)
The database architectures research group at CWI
ACM SIGMOD Record
SharedDB: killing one thousand queries with one stone
Proceedings of the VLDB Endowment
gbase: an efficient analysis platform for large graphs
The VLDB Journal — The International Journal on Very Large Data Bases
Enhanced stream processing in a DBMS kernel
Proceedings of the 16th International Conference on Extending Database Technology
Scaling up analytical queries with column-stores
Proceedings of the Sixth International Workshop on Testing Database Systems
Data vaults: a database welcome to scientific file repositories
Proceedings of the 25th International Conference on Scientific and Statistical Database Management
Just-in-time compilation for SQL query processing
Proceedings of the VLDB Endowment
Lazy ETL in action: ETL technology dates scientific data
Proceedings of the VLDB Endowment
Hi-index | 0.00 |
Automatically recycling (intermediate) results is a grand challenge for state-of-the-art databases to improve both query response time and throughput. Tuples are loaded and streamed through a tuple-at-a-time processing pipeline avoiding materialization of intermediates as much as possible. This limits the opportunities for reuse of overlapping computations to DBA-defined materialized views and function/result cache tuning. In contrast, the operator-at-a-time execution paradigm produces fully materialized results in each step of the query plan. To avoid resource contention, these intermediates are evicted as soon as possible. In this paper we study an architecture that harvests the by-products of the operator-at-a-time paradigm in a column store system using a lightweight mechanism, the recycler. The key challenge then becomes selection of the policies to admit intermediates to the resource pool, their retention period, and the eviction strategy when facing resource limitations. The proposed recycling architecture has been implemented in an open-source system. An experimental analysis against the TPC-H ad-hoc decision support benchmark and a complex, real-world application (SkyServer) demonstrates its effectiveness in terms of self-organizing behavior and its significant performance gains. The results indicate the potentials of recycling intermediates and charters a route for further development of database kernels.