Requirement-based query and update scheduling in real-time data warehouses

Authors:
Fangling Leng;Yubin Bao;Ge Yu;Jingang Shi;Xiaoyan Cai
Affiliations:
School of Information Science & Engineering, Northeastern University, Shenyang, P.R. China;School of Information Science & Engineering, Northeastern University, Shenyang, P.R. China;School of Information Science & Engineering, Northeastern University, Shenyang, P.R. China;School of Information Science & Engineering, Northeastern University, Shenyang, P.R. China;School of Information Science & Engineering, Northeastern University, Shenyang, P.R. China
Venue:
WAIM'11 Proceedings of the 12th international conference on Web-age information management
Year:
2011

Citing 9
Cited 0

Scheduling hard real-time systems: a review

Software Engineering Journal - Special issue on real-time software
Update Propagation Strategies for Improving the Quality of Data on the Web

Proceedings of the 27th International Conference on Very Large Data Bases
UNIT: User-centric Transaction Management in Web-Database Systems

ICDE '06 Proceedings of the 22nd International Conference on Data Engineering
The making of TPC-DS

VLDB '06 Proceedings of the 32nd international conference on Very large data bases
Partition-based workload scheduling in living data warehouse environments

Proceedings of the ACM tenth international workshop on Data warehousing and OLAP
rFEED: A Mixed Workload Scheduler for Enterprise Data Warehouses

ICDE '09 Proceedings of the 2009 IEEE International Conference on Data Engineering
Scheduling Updates in a Real-Time Stream Warehouse

ICDE '09 Proceedings of the 2009 IEEE International Conference on Data Engineering
Priority-Based Balance Scheduling in Real-Time Data Warehouse

HIS '09 Proceedings of the 2009 Ninth International Conference on Hybrid Intelligent Systems - Volume 03
Multiple query scheduling for distributed semantic caches

Journal of Parallel and Distributed Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

A typical real-time data warehouse continually receives readonly queries from users and write-only updates from a variety of external sources. Queries may conflict with updates due to the resource competition and high loads. Moreover, users expect short response time for queries and low staleness for the query results. This makes it challenging to satisfy the two requirements simultaneously. This paper proposes a requirement-based querying and updating scheduling algorithm (RQUS) which allows users to express their real needs for their queries by specifying the acceptable response time delay and the acceptable result staleness when queries are submitted. RQUS dynamically adjusts the work mode of the system according to the changing requirements of users in order to allocate system resource to queries or updates and then prioritizes the query or update queue according to the work mode. And a freshness monitor is adopted to monitor the execution state of updating tasks in order to maintain the global table incrementally. Experimental results show that RQUS algorithm performs better than the three traditional scheduling algorithms with the changing user requirements overall.