Physical database design for relational databases
ACM Transactions on Database Systems (TODS)
ACM SIGMOD Record
Communications of the ACM
ICDE '95 Proceedings of the Eleventh International Conference on Data Engineering
Selecting an Optimal Set of Secondary Indices
Proceedings of the Proceedings of the 1st European Cooperation in Informatics on ECI Conference 1976
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Physical design refinement: The ‘merge-reduce’ approach
ACM Transactions on Database Systems (TODS)
Self-tuning database systems: a decade of progress
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Autonomous Management of Soft Indexes
ICDEW '07 Proceedings of the 2007 IEEE 23rd International Conference on Data Engineering Workshop
Self-organizing tuple reconstruction in column-stores
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Self-selecting, self-tuning, incrementally optimized indexes
Proceedings of the 13th International Conference on Extending Database Technology
A survey of B-tree locking techniques
ACM Transactions on Database Systems (TODS)
Benchmarking adaptive indexing
TPCTC'10 Proceedings of the Second TPC technology conference on Performance evaluation, measurement and characterization of complex systems
The database architectures research group at CWI
ACM SIGMOD Record
Stochastic database cracking: towards robust adaptive indexing in main-memory column-stores
Proceedings of the VLDB Endowment
Concurrency control for adaptive indexing
Proceedings of the VLDB Endowment
Holistic indexing: offline, online and adaptive indexing in the same kernel
PhD '12 Proceedings of the on SIGMOD/PODS 2012 PhD Symposium
NoDB: efficient query execution on raw data files
SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
Adaptive indexing in modern database kernels
Proceedings of the 15th International Conference on Extending Database Technology
Sliced column-store (SCS): ontological foundations and practical implications
ER'12 Proceedings of the 31st international conference on Conceptual Modeling
SMIX: self-managing indexes for dynamic workloads
Proceedings of the 25th International Conference on Scientific and Statistical Database Management
Mosquito: another one bites the data upload stream
Proceedings of the VLDB Endowment
Instant loading for main memory databases
Proceedings of the VLDB Endowment
Hi-index | 0.00 |
Adaptive indexing is characterized by the partial creation and refinement of the index as side effects of query execution. Dynamic or shifting workloads may benefit from preliminary index structures focused on the columns and specific key ranges actually queried --- without incurring the cost of full index construction. The costs and benefits of adaptive indexing techniques should therefore be compared in terms of initialization costs, the overhead imposed upon queries, and the rate at which the index converges to a state that is fully-refined for a particular workload component. Based on an examination of database cracking and adaptive merging, which are two techniques for adaptive indexing, we seek a hybrid technique that has a low initialization cost and also converges rapidly. We find the strengths and weaknesses of database cracking and adaptive merging complementary. One has a relatively high initialization cost but converges rapidly. The other has a low initialization cost but converges relatively slowly. We analyze the sources of their respective strengths and explore the space of hybrid techniques. We have designed and implemented a family of hybrid algorithms in the context of a column-store database system. Our experiments compare their behavior against database cracking and adaptive merging, as well as against both traditional full index lookup and scan of unordered data. We show that the new hybrids significantly improve over past methods while at least two of the hybrids come very close to the "ideal performance" in terms of both overhead per query and convergence to a final state.