Adaptive Load Management over Real-Time Data Streams

Authors:
Xin Li;Li Ma;Kun Li;Kun Wang;Hong-An Wang
Affiliations:
Chinese Academy of Sciences, Beijing;Chinese Academy of Sciences, Beijing;Chinese Academy of Sciences, Beijing;Intelligence Engineering Laboratory, Institute of Software;Intelligence Engineering Laboratory, Institute of Software
Venue:
FSKD '07 Proceedings of the Fourth International Conference on Fuzzy Systems and Knowledge Discovery - Volume 02
Year:
2007

Citing 0
Cited 1

Load Shedding for Shared Window Join over Real-Time Data Streams

APWeb/WAIM '09 Proceedings of the Joint International Conferences on Advances in Data and Web Management

Quantified Score

Hi-index	0.00

Visualization

Abstract

Streaming applications require long-running query services against data streams. Existing data stream management systems (DSMSs) are poor at processing long-running queries with timing constrains. To address this problem, we present a real-time DSMS which can support real-time query services in unpredictable environments. In this system, long- running queries over data streams are divided into two classes: periodic and continuous queries. A mixed query model is introduced to characterize these two kinds of real-time queries. Furthermore, an Adaptive Load Management (ALM) strategy based on dynamic execution time prediction is proposed to distribute processor time among all query instances. The objective of the ALM strategy is to provide certain guarantee on the deadline miss ratio of periodic queries and reduce the one of continuous queries, meanwhile maximizing overall query quality. A series of experiments confirm that the ALM strategy is effective in improving query quality and managing workload fluctuations.