Random sampling with a reservoir
ACM Transactions on Mathematical Software (TOMS)
Probabilistic counting algorithms for data base applications
Journal of Computer and System Sciences
Dynamic query evaluation plans
SIGMOD '89 Proceedings of the 1989 ACM SIGMOD international conference on Management of data
On the propagation of errors in the size of join results
SIGMOD '91 Proceedings of the 1991 ACM SIGMOD international conference on Management of data
Adaptive query optimization in a deductive database system
CIKM '93 Proceedings of the second international conference on Information and knowledge management
Optimization of dynamic query evaluation plans
SIGMOD '94 Proceedings of the 1994 ACM SIGMOD international conference on Management of data
Balancing histogram optimality and practicality for query result size estimation
SIGMOD '95 Proceedings of the 1995 ACM SIGMOD international conference on Management of data
Improved histograms for selectivity estimation of range predicates
SIGMOD '96 Proceedings of the 1996 ACM SIGMOD international conference on Management of data
Building a scaleable geo-spatial DBMS: technology, implementation, and evaluation
SIGMOD '97 Proceedings of the 1997 ACM SIGMOD international conference on Management of data
Decomposition—a strategy for query processing
ACM Transactions on Database Systems (TODS)
Scrambling query plans to cope with unexpected delays
DIS '96 Proceedings of the fourth international conference on on Parallel and distributed information systems
Access path selection in a relational database management system
SIGMOD '79 Proceedings of the 1979 ACM SIGMOD international conference on Management of data
Buffer management based on return on consumption in a multi-query environment
The VLDB Journal — The International Journal on Very Large Data Bases
Dynamic Query Optimization in Rdb/VMS
Proceedings of the Ninth International Conference on Data Engineering
Dynamic Optimization of Index Scans Restricted by Booleans
ICDE '96 Proceedings of the Twelfth International Conference on Data Engineering
Measuring the Complexity of Join Enumeration in Query Optimization
VLDB '90 Proceedings of the 16th International Conference on Very Large Data Bases
Using Segmented Right-Deep Trees for the Execution of Pipelined Hash Joins
VLDB '92 Proceedings of the 18th International Conference on Very Large Data Bases
VLDB '92 Proceedings of the 18th International Conference on Very Large Data Bases
Dynamic Memory Allocation for Multiple-Query Workloads
VLDB '93 Proceedings of the 19th International Conference on Very Large Data Bases
OPT++ : an object-oriented implementation for extensible database query optimization
The VLDB Journal — The International Journal on Very Large Data Bases
Query optimization for object-relational database systems
Query optimization for object-relational database systems
Least expected cost query optimization: an exercise in utility
PODS '99 Proceedings of the eighteenth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Self-tuning histograms: building histograms without looking at data
SIGMOD '99 Proceedings of the 1999 ACM SIGMOD international conference on Management of data
An adaptive query execution system for data integration
SIGMOD '99 Proceedings of the 1999 ACM SIGMOD international conference on Management of data
Rule-based query optimization, revisited
Proceedings of the eighth international conference on Information and knowledge management
Eddies: continuously adaptive query processing
SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
The state of the art in distributed query processing
ACM Computing Surveys (CSUR)
Rate-based query optimization for streaming information sources
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Partial results for online query processing
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Ginga: a self-adaptive query processing system
Proceedings of the eleventh international conference on Information and knowledge management
The cougar approach to in-network query processing in sensor networks
ACM SIGMOD Record
Automatic tuning of data synopses
Information Systems - Special issue: Best papers from EDBT 2002
A Framework for the Physical Design Problem for Data Synopses
EDBT '02 Proceedings of the 8th International Conference on Extending Database Technology: Advances in Database Technology
Combining Histograms and Parametric Curve Fitting for Feedback-Driven Query Result-size Estimation
VLDB '99 Proceedings of the 25th International Conference on Very Large Data Bases
Dynamic Pipeline Scheduling for Improving Interactive Query Performance
Proceedings of the 27th International Conference on Very Large Data Bases
LEO - DB2's LEarning Optimizer
Proceedings of the 27th International Conference on Very Large Data Bases
Query Processing in Self-Profiling Composable Peer-to-Peer Mediator Databases
EDBT '02 Proceedings of the Worshops XMLDM, MDDE, and YRWS on XML-Based Data Management and Multimedia Engineering-Revised Papers
Adaptive Query Processing: A Survey
BNCOD 19 Proceedings of the 19th British National Conference on Databases: Advances in Databases
A Classification of Skew Effects in Parallel Database Systems
Euro-Par '01 Proceedings of the 7th International Euro-Par Conference Manchester on Parallel Processing
Hybrid Simultaneous Scheduling and Mapping in SQL Multi-query Parallelization
DEXA '99 Proceedings of the 10th International Conference on Database and Expert Systems Applications
An XML query engine for network-bound data
The VLDB Journal — The International Journal on Very Large Data Bases
MIL primitives for querying a fragmented world
The VLDB Journal — The International Journal on Very Large Data Bases
Chain: operator scheduling for memory minimization in data stream systems
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Estimating compilation time of a query optimizer
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Quality of service in an information economy
ACM Transactions on Internet Technology (TOIT)
Distributed query adaptation and its trade-offs
Proceedings of the 2003 ACM symposium on Applied computing
Adapting to source properties in processing data integration queries
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Adaptive ordering of pipelined stream filters
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Static optimization of conjunctive queries with sliding windows over infinite streams
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Dynamic plan migration for continuous queries over data streams
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Robust query processing through progressive optimization
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Toward a progress indicator for database queries
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Estimating progress of execution for SQL queries
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
LEO: An autonomic query optimizer for DB2
IBM Systems Journal
Journal of Intelligent Information Systems
Operator scheduling in data stream systems
The VLDB Journal — The International Journal on Very Large Data Bases
Self-monitoring query execution for adaptive query processing
Data & Knowledge Engineering
Adaptive Caching for Continuous Queries
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Increasing the Accuracy and Coverage of SQL Progress Indicators
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
QPipe: a simultaneously pipelined relational query engine
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
When can we trust progress estimators for SQL queries?
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Proactive re-optimization with Rio
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
An adaptable distributed query processing architecture
Data & Knowledge Engineering
Content-based routing: different plans for different data
VLDB '05 Proceedings of the 31st international conference on Very large data bases
VLDB '05 Proceedings of the 31st international conference on Very large data bases
Selectivity-based partitioning: a divide-and-union paradigm for effective query optimization
Proceedings of the 14th ACM international conference on Information and knowledge management
Data integration: the teenage years
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
Adaptive rank-aware query optimization in relational databases
ACM Transactions on Database Systems (TODS)
Mobile join operators for restricted sources
Mobile Information Systems
The use of Hints in SQL-Nested query optimization
Information Sciences: an International Journal
Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Towards a query optimizer for text-centric tasks
ACM Transactions on Database Systems (TODS)
Lifting the burden of history from adaptive query processing
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Self-tuning database systems: a decade of progress
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Adaptive aggregation on chip multiprocessors
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Stop-and-restart style execution for long running decision support queries
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
On the production of anorexic plan diagrams
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Foundations and Trends in Databases
A monitoring service for large-scale dynamic query optimisation in a grid environment
International Journal of Web and Grid Services
A strategy to develop adaptive and interactive query brokers
IDEAS '08 Proceedings of the 2008 international symposium on Database engineering & applications
Identifying robust plans through plan diagram reduction
Proceedings of the VLDB Endowment
A pay-as-you-go framework for query execution feedback
Proceedings of the VLDB Endowment
Evita raced: metacompilation for declarative networks
Proceedings of the VLDB Endowment
Efficiently approximating query optimizer plan diagrams
Proceedings of the VLDB Endowment
Optimizer plan change management: improved stability and performance in Oracle 11g
Proceedings of the VLDB Endowment
Closing the query processing loop in Oracle 11g
Proceedings of the VLDB Endowment
PROQID: partial restarts of queries in distributed databases
Proceedings of the 17th ACM conference on Information and knowledge management
The design of a query monitoring system
ACM Transactions on Database Systems (TODS)
Self-tuning query mesh for adaptive multi-route query processing
Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
Adaptive workload allocation in query processing in autonomous heterogeneous environments
Distributed and Parallel Databases
ROX: run-time optimization of XQueries
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Dynamic plan generation for parameterized queries
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Query optimizers: time to rethink the contract?
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Evolution of Query Optimization Methods: From Centralized Database Systems to Data Grid Systems
DEXA '09 Proceedings of the 20th International Conference on Database and Expert Systems Applications
Location-aware privacy and more: a systems approach using context-aware database management systems
Proceedings of the 2nd SIGSPATIAL ACM GIS 2009 International Workshop on Security and Privacy in GIS and LBS
StatAdvisor: recommending statistical views
Proceedings of the VLDB Endowment
MCC-DB: minimizing cache conflicts in multi-core processors for databases
Proceedings of the VLDB Endowment
Exact cardinality query optimization for optimizer testing
Proceedings of the VLDB Endowment
Adaptive join processing in pipelined plans
Proceedings of the 13th International Conference on Extending Database Technology
Warm cache costing: a feedback optimization technique for buffer pool aware costing
Proceedings of the 13th International Conference on Extending Database Technology
Automation everywhere: autonomics and data management
BNCOD'07 Proceedings of the 24th British national conference on Databases
Teddies: trained Eddies for reactive stream processing
DASFAA'08 Proceedings of the 13th international conference on Database systems for advanced applications
Dynamic query optimisation: towards decentralised methods
International Journal of Intelligent Information and Database Systems
OSDI'08 Proceedings of the 8th USENIX conference on Operating systems design and implementation
On the stability of plan costs and the costs of plan stability
Proceedings of the VLDB Endowment
The Picasso database query optimizer visualizer
Proceedings of the VLDB Endowment
Efficient processing of monotonic linear progressive queries via dynamic materialized views
Proceedings of the 2010 Conference of the Center for Advanced Studies on Collaborative Research
Mobile Information Systems
Run-time adaptivity for search computing
Search computing
Progressive query optimization for federated queries
EDBT'06 Proceedings of the 10th international conference on Advances in Database Technology
SSTD'05 Proceedings of the 9th international conference on Advances in Spatial and Temporal Databases
Recursive SQL query optimization with k-iteration lookahead
DEXA'06 Proceedings of the 17th international conference on Database and Expert Systems Applications
A foundation for the replacement of pipelined physical join operators in adaptive query processing
EDBT'06 Proceedings of the 2006 international conference on Current Trends in Database Technology
Hirundo: a mechanism for automated production of optimized data stream graphs
ICPE '12 Proceedings of the 3rd ACM/SPEC International Conference on Performance Engineering
Adaptive optimizations of recursive queries in teradata
SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
Re-optimizing data-parallel computing
NSDI'12 Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation
Optimizing adaptive multi-route query processing via time-partitioned indices
Journal of Computer and System Sciences
Distributed Adaptive Windowed Stream Join Processing
International Journal of Distributed Systems and Technologies
Shark: SQL and rich analytics at scale
Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
Optimus: a dynamic rewriting framework for data-parallel execution plans
Proceedings of the 8th ACM European Conference on Computer Systems
Continuous cloud-scale query optimization and processing
Proceedings of the VLDB Endowment
Automatic optimization of stream programs via source program operator graph transformations
Distributed and Parallel Databases
Exploring optimization and caching for efficient collection operations
Automated Software Engineering
Hi-index | 0.00 |
For a number of reasons, even the best query optimizers can very often produce sub-optimal query execution plans, leading to a significant degradation of performance. This is especially true in databases used for complex decision support queries and/or object-relational databases. In this paper, we describe an algorithm that detects sub-optimality of a query execution plan during query execution and attempts to correct the problem. The basic idea is to collect statistics at key points during the execution of a complex query. These statistics are then used to optimize the execution of the query, either by improving the resource allocation for that query, or by changing the execution plan for the remainder of the query. To ensure that this does not significantly slow down the normal execution of a query, the Query Optimizer carefully chooses what statistics to collect, when to collect them, and the circumstances under which to re-optimize the query. We describe an implementation of this algorithm in the Paradise Database System, and we report on performance studies, which indicate that this can result in significant improvements in the performance of complex queries.