Handbook of theoretical computer science (vol. B)
The temporal logic of reactive and concurrent systems
The temporal logic of reactive and concurrent systems
Models and issues in data stream systems
Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Rate-based query optimization for streaming information sources
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Semantic Query Optimization for Object Databases
ICDE '97 Proceedings of the Thirteenth International Conference on Data Engineering
Implementation of Two Semantic Query Optimization Techniques in DB2 Universal Database
VLDB '99 Proceedings of the 25th International Conference on Very Large Data Bases
Exploiting Punctuation Semantics in Continuous Data Streams
IEEE Transactions on Knowledge and Data Engineering
Approximate join processing over data streams
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Gigascope: a stream database for network applications
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Aurora: a new model and architecture for data stream management
The VLDB Journal — The International Journal on Very Large Data Bases
MJoin: a metadata-aware stream join operator
Proceedings of the 2nd international workshop on Distributed event-based systems
Exploiting k-constraints to reduce memory overhead in continuous queries over data streams
ACM Transactions on Database Systems (TODS)
The BEA streaming XQuery processor
The VLDB Journal — The International Journal on Very Large Data Bases
Semantic query optimization for XQuery over XML streams
VLDB '05 Proceedings of the 31st international conference on Very large data bases
ACM SIGMOD Record
Checks and balances: monitoring data quality problems in network traffic databases
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
Linear road: a stream data management benchmark
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Extending XQuery with window functions
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Efficient pattern matching over event streams
Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Optimizing away joins on data streams
SSPS '08 Proceedings of the 2nd international workshop on Scalable stream processing system
Out-of-order processing: a new architecture for high-performance stream systems
Proceedings of the VLDB Endowment
Towards a streaming SQL standard
Proceedings of the VLDB Endowment
Flexible and scalable storage management for data-intensive stream processing
Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
Query-Aware Partitioning for Monitoring Massive Network Data Streams
ICDE '08 Proceedings of the 2008 IEEE 24th International Conference on Data Engineering
Sequence Pattern Query Processing over Out-of-Order Event Streams
ICDE '09 Proceedings of the 2009 IEEE International Conference on Data Engineering
DejaVu: declarative pattern matching over live and archived streams of events
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Towards expressive publish/subscribe systems
EDBT'06 Proceedings of the 10th international conference on Advances in Database Technology
Schema matching and mapping: from usage to evaluation
Proceedings of the 14th International Conference on Extending Database Technology
Transactional stream processing
Proceedings of the 15th International Conference on Extending Database Technology
Hi-index | 0.00 |
Schemas, and more generally metadata specifying structural and semantic constraints, are invaluable in data management. They facilitate conceptual design and enable checking of data consistency. They also play an important role in permitting semantic query optimization, that is, optimization and processing strategies that are often highly effective, but only correct for data conforming to a given schema. While the use of metadata is well-established in relational and XML databases, the same is not true for data streams. The existing work mostly focuses on the specification of dynamic information. In this paper, we consider the specification of static metadata for streams in a model called Stream Schema. We show how Stream Schema can be used to validate the consistency of streams. By explicitly modeling stream constraints, we show that stream queries can be simplified by removing predicates or subqueries that check for consistency. This can greatly enhance pro-grammability of stream processing systems. We also present a set of semantic query optimization strategies that both permit compile-time checking of queries (for example, to detect empty queries) and new runtime processing options, options that would not have been possible without a Stream Schema specification. Case studies on two stream processing platforms (covering different applications and underlying stream models), along with an experimental evaluation, show the benefits of Stream Schema.