Synchronizing data stream processing

Authors:
Muhammad S. F. Qureshi;Janusz R. Getta
Affiliations:
School of IT and Computer Science, University of Wollongong, Wollongong, Australia;School of IT and Computer Science, University of Wollongong, Wollongong, Australia
Venue:
PDCN'07 Proceedings of the 25th conference on Proceedings of the 25th IASTED International Multi-Conference: parallel and distributed computing and networks
Year:
2007

Citing 8
Cited 0

Concurrency control and recovery in database systems

Concurrency control and recovery in database systems
NiagaraCQ: a scalable continuous query system for Internet databases

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Models and issues in data stream systems

Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Characterizing memory requirements for queries over continuous data streams

Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Tribeca: A Stream Database Manager for Network Traffic Analysis

VLDB '96 Proceedings of the 22th International Conference on Very Large Data Bases
Guest Editor Introduction: Special Section on Online Analysis and Querying of Continuous Data Streams

IEEE Transactions on Knowledge and Data Engineering
TelegraphCQ: continuous dataflow processing

Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Tuple routing strategies for distributed eddies

VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29

Quantified Score

Hi-index	0.00

Visualization

Abstract

Synchronization of data stream processing has a significant impact on performance of systems where processing of long sequences of data items needs to be done simultaneously. In earlier works on stream processing, synchronization has been discussed to a limited extent or has been completely overlooked. This work describes a formal model of synchronization in a data stream processing network. We use a notation of data stream processing networks to identify circumstances that necessitate synchronization and express processing of data items in a data stream processing network in terms of database transactions. A technique similar to timestamp ordering of database transactions is used to solve the problems. A solution is presented as a set of rules that govern processing of individual data items. A proof of correctness for the strategy used is also provided.