No pane, no gain: efficient evaluation of sliding-window aggregates over data streams

Authors:
Jin Li;David Maier;Kristin Tufte;Vassilis Papadimos;Peter A. Tucker
Affiliations:
Portland State University, Portland, OR;Portland State University, Portland, OR;Portland State University, Portland, OR;Portland State University, Portland, OR;Whitworth College, Spokane, WA
Venue:
ACM SIGMOD Record
Year:
2005

Citing 6
Cited 41

Models and issues in data stream systems

Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals

Data Mining and Knowledge Discovery
Gigascope: a stream database for network applications

Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Holistic UDAFs at streaming speeds

SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Monitoring streams: a new class of data management applications

VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Resource sharing in continuous sliding-window aggregates

VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30

Semantics and evaluation techniques for window aggregates in data streams

Proceedings of the 2005 ACM SIGMOD international conference on Management of data
A heartbeat mechanism and its application in gigascope

VLDB '05 Proceedings of the 31st international conference on Very large data bases
On-the-fly sharing for streamed aggregation

Proceedings of the 2006 ACM SIGMOD international conference on Management of data
Sharing aggregate computation for distributed queries

Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Algorithms and metrics for processing multiple heterogeneous continuous queries

ACM Transactions on Database Systems (TODS)
Query-aware partitioning for monitoring massive network data streams

Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Index tuning for parameterized streaming groupby queries

SSPS '08 Proceedings of the 2nd international workshop on Scalable stream processing system
Out-of-order processing: a new architecture for high-performance stream systems

Proceedings of the VLDB Endowment
Optimal sampling from sliding windows

Proceedings of the twenty-eighth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Sliding window-based frequent pattern mining over data streams

Information Sciences: an International Journal
Evaluating MAX and MIN over sliding windows with various size using the exemplary sketch

DASFAA'07 Proceedings of the 12th international conference on Database systems for advanced applications
Supporting top-k aggregate queries over unequal synopsis on internet traffic streams

APWeb'08 Proceedings of the 10th Asia-Pacific web conference on Progress in WWW research and development
Approximating sliding windows by cyclic tree-like histograms for efficient range queries

Data & Knowledge Engineering
Online pattern aggregation over RFID data streams

WAIM'10 Proceedings of the 11th international conference on Web-age information management
Fast and accurate computation of equi-depth histograms over data streams

Proceedings of the 14th International Conference on Extending Database Technology
Relational languages and data models for continuous queries on sequences and data streams

ACM Transactions on Database Systems (TODS)
In-situ MapReduce for log processing

USENIXATC'11 Proceedings of the 2011 USENIX conference on USENIX annual technical conference
Update propagation in a streaming warehouse

SSDBM'11 Proceedings of the 23rd international conference on Scientific and statistical database management
Subsuming multiple sliding windows for shared stream computation

ADBIS'11 Proceedings of the 15th international conference on Advances in databases and information systems
Optimized processing of multiple aggregate continuous queries

Proceedings of the 20th ACM international conference on Information and knowledge management
Query answering on trajectory cuboids using prime numbers encodings

Proceedings of the 15th Symposium on International Database Engineering & Applications
Optimal sampling from sliding windows

Journal of Computer and System Sciences
Shared execution strategy for neighbor-based pattern mining requests over streaming windows

ACM Transactions on Database Systems (TODS)
In-situ MapReduce for log processing

HotCloud'11 Proceedings of the 3rd USENIX conference on Hot topics in cloud computing
Efficient and effective query answering for trajectory cuboids

FQAS'11 Proceedings of the 9th international conference on Flexible Query Answering Systems
C-MR: continuously executing MapReduce workflows on multi-core processors

Proceedings of third international workshop on MapReduce and its Applications Date
Interactive mining of high utility patterns over data streams

Expert Systems with Applications: An International Journal
Capturing episodes: may the frame be with you

Proceedings of the 6th ACM International Conference on Distributed Event-Based Systems
Chimera: a declarative language for streaming network traffic analysis

Security'12 Proceedings of the 21st USENIX conference on Security symposium
Efficient processing of multiple continuous skyline queries over a data stream

Information Sciences: an International Journal
Enhanced stream processing in a DBMS kernel

Proceedings of the 16th International Conference on Extending Database Technology
Multi-query optimization for semantic news feed query

Proceedings of the International Conference on Management of Emergent Digital EcoSystems
Database support for processing complex aggregate queries over data streams

Proceedings of the Joint EDBT/ICDT 2013 Workshops
Overcoming memory limitations in high-throughput event-based applications

Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering
Mining frequent itemsets over tuple-evolving data streams

Proceedings of the 28th Annual ACM Symposium on Applied Computing
Continuous query processing with concurrency control: reading updatable resources consistently

Proceedings of the 28th Annual ACM Symposium on Applied Computing
Grand challenge: SPRINT stream processing engine as a solution

Proceedings of the 7th ACM international conference on Distributed event-based systems
Data stream processing with concurrency control

ACM SIGAPP Applied Computing Review
Mining associated sensor patterns for data stream of wireless sensor networks

Proceedings of the 8th ACM workshop on Performance monitoring and measurement of heterogeneous wireless and wired networks
Sequential pattern mining from trajectory data

Proceedings of the 17th International Database Engineering & Applications Symposium
Towards window stream queries over continuous phenomena

Proceedings of the 4th ACM SIGSPATIAL International Workshop on GeoStreaming

Quantified Score

Hi-index	0.00

Visualization

Abstract

Windows queries are proving essential to data-stream processing. In this paper, we present an approach for evaluating sliding-window aggregate queries that reduces both space and computation time for query execution. Our approach divides overlapping windows into disjoint panes, computes sub-aggregates over each pane, and "rolls up" the pane-aggregates to computer window-aggregates. Our experimental study shows that using panes has significant performance benefits.