Cache-based aggregate query shipping: an efficient scheme of distributed OLAP query processing

Authors:
Hua-Ming Liao;Guo-Shun Pei
Affiliations:
Research Center for Grid and Service Computing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China;Research Center for Grid and Service Computing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
Venue:
Journal of Computer Science and Technology
Year:
2008

Citing 11
Cited 0

Performance tradeoffs for client-server query processing

SIGMOD '96 Proceedings of the 1996 ACM SIGMOD international conference on Management of data
Caching multidimensional queries using chunks

SIGMOD '98 Proceedings of the 1998 ACM SIGMOD international conference on Management of data
DynaMat: a dynamic view management system for data warehouses

SIGMOD '99 Proceedings of the 1999 ACM SIGMOD international conference on Management of data
The state of the art in distributed query processing

ACM Computing Surveys (CSUR)
Garlic: a new flavor of federated query processing for DB2

Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Including Group-By in Query Optimization

VLDB '94 Proceedings of the 20th International Conference on Very Large Data Bases
Semantic Data Caching and Replacement

VLDB '96 Proceedings of the 22th International Conference on Very Large Data Bases
WATCHMAN: A Data Warehouse Intelligent Cache Manager

VLDB '96 Proceedings of the 22th International Conference on Very Large Data Bases
Performance and overhead of semantic cache management

ACM Transactions on Internet Technology (TOIT)
Efficient exploitation of similar subexpressions for query processing

Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Request Window: an approach to improve throughput of RDBMS-based data integration system by utilizing data sharing across concurrent distributed queries

VLDB '07 Proceedings of the 33rd international conference on Very large data bases

Quantified Score

Hi-index	0.00

Visualization

Abstract

Our study introduces a novel distributed query plan refinement phase in an enhanced architecture of distributed query processing engine (DQPE). Query plan refinement generates potentially efficient distributed query plan by reusable aggregate query shipping (RAQS) approach. The approach improves response time at the cost of pre-processing time. If the overheads could not be compensated by query results reusage, RAQS is no more favorable. Therefore a global cost estimation model is employed to get proper operators: RR_Agg, R_Agg, or R_Scan. For the purpose of reusing results of queries with aggregate function in distributed query processing, a multi-level hybrid view caching (HVC) scheme is introduced. The scheme retains the advantages of partial match and aggregate query results caching. By our solution, evaluations with distributed. TPC-H queries show significant improvement on average response time.