Load shedding for window joins over streams

  • Authors:

  • Donghong Han;Chuan Xiao;Rui Zhou;Guoren Wang;Huan Huo;Xiaoyun Hui

  • Affiliations:

  • Northeastern University, Shenyang, China;Northeastern University, Shenyang, China;Northeastern University, Shenyang, China;Northeastern University, Shenyang, China;Northeastern University, Shenyang, China;Northeastern University, Shenyang, China

  • Venue:
  • WAIM '06 Proceedings of the 7th international conference on Advances in Web-Age Information Management
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a novel load shedding technique over sliding window joins. We first construct a dual window architectural model including join-windows and aux-windows. With the statistics built on aux-windows, an effective load shedding strategy is developed to produce maximum subset join outputs. For the streams with high arrival rates, we propose an approach incorporating front-shedding and rear-shedding, and then address the problem of how to cooperate these two shedding processes through a series of calculations. Based on extensive experimentation with synthetic data and real life data, we show that our load shedding strategy delivers superb join output performance, and dominates the existing strategies.