A deadline-sensitive approach for real-time processing of sliding windows

Authors:
Wu Shanshan;Yu Ge;Yu Yaxin;Ou Zhengyu;Yang Xinhua;Gu Yu
Affiliations:
Northeastern University, Shenyang, China;Northeastern University, Shenyang, China;Northeastern University, Shenyang, China;Northeastern University, Shenyang, China;Northeastern University, Shenyang, China;Northeastern University, Shenyang, China
Venue:
WAIM'05 Proceedings of the 6th international conference on Advances in Web-Age Information Management
Year:
2005

Citing 10
Cited 0

Eddies: continuously adaptive query processing

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
NiagaraCQ: a scalable continuous query system for Internet databases

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
QoS-Driven Load Shedding on Data Streams

EDBT '02 Proceedings of the Worshops XMLDM, MDDE, and YRWS on XML-Based Data Management and Multimedia Engineering-Revised Papers
Approximate join processing over data streams

Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Chain: operator scheduling for memory minimization in data stream systems

Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Aurora: a new model and architecture for data stream management

The VLDB Journal — The International Journal on Very Large Data Bases
Adaptive ordering of pipelined stream filters

SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Flexible time management in data stream systems

PODS '04 Proceedings of the twenty-third ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Monitoring streams: a new class of data management applications

VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Operator scheduling in a data stream manager

VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29

Quantified Score

Hi-index	0.00

Visualization

Abstract

In a growing number of information processing applications, data takes the form of continuous data streams rather than traditional stored databases. Most of these applications have sophisticated real-time constraint that needs to be met under unbounded, high-volume, time-varying data streams. We introduce deadline as a real-time constraint of continuous query over data streams. Specifically, a deadline-sensitive approach for sliding window processing is proposed, which predicts a sliding window would satisfy its deadline or not. Once deadline missing is predicted, HopDrop, a proposed load shedding strategy would be applied to lighten the system burden in advance. Furthermore, feedback control mechanism is applied to improve the adaptivity of our approach. Extensive experimental results are presented and analyzed to validate our strategies.