Schema-based scheduling of event processors and buffer minimization for queries on structured data streams

Authors:
Christoph Koch;Stefanie Scherzinger;Nicole Schweikardt;Bernhard Stegmaier
Affiliations:
Technische Universität Wien, Vienna, Austria;Technische Universität Wien, Vienna, Austria;Humboldt Universität zu Berlin, Berlin, Germany;Technische Universität München, Munich, Germany
Venue:
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Year:
2004

Citing 12
Cited 46

One-unambiguous regular languages

Information and Computation
Query processing of streamed XML data

Proceedings of the eleventh international conference on Information and knowledge management
Reformulation of XML Queries and Constraints

ICDT '03 Proceedings of the 9th International Conference on Database Theory
Processing XML Streams with Deterministic Automata

ICDT '03 Proceedings of the 9th International Conference on Database Theory
Efficient Filtering of XML Documents for Selective Dissemination of Information

VLDB '00 Proceedings of the 26th International Conference on Very Large Data Bases
Stream processing of XPath queries with predicates

Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Efficient Filtering of XML Documents with XPath Expressions

ICDE '02 Proceedings of the 18th International Conference on Data Engineering
A transducer-based XML query processor

VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Path queries on compressed XML

VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
Projecting XML documents

VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
The BEA/XQRL streaming XQuery processor

VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
Schema-based scheduling of event processors and buffer minimization for queries on structured data streams

VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30

StreamGlobe: adaptive query processing and optimization in streaming P2P environments

DMSN '04 Proceeedings of the 1st international workshop on Data management for sensor networks: in conjunction with VLDB 2004
On the complexity of nonrecursive XQuery and functional query languages on complex values

Proceedings of the twenty-fourth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Buffering in query evaluation over XML streams

Proceedings of the twenty-fourth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Efficient evaluation of XQuery over streaming data

VLDB '05 Proceedings of the 31st international conference on Very large data bases
StreamGlobe: processing and sharing data streams in grid-based P2P infrastructures

VLDB '05 Proceedings of the 31st international conference on Very large data bases
Processing queries on tree-structured data efficiently

Proceedings of the twenty-fifth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
MonetDB/XQuery: a fast XQuery processor powered by a relational engine

Proceedings of the 2006 ACM SIGMOD international conference on Management of data
PTDOM: a schema-aware XML database system for MPEG-7 media descriptions

Software—Practice & Experience - Research Articles
Inference of concise DTDs from XML data

VLDB '06 Proceedings of the 32nd international conference on Very large data bases
AFilter: adaptable XML filtering with prefix-caching suffix-clustering

VLDB '06 Proceedings of the 32nd international conference on Very large data bases
On the complexity of nonrecursive XQuery and functional query languages on complex values

ACM Transactions on Database Systems (TODS)
Automata for XML---A survey

Journal of Computer and System Sciences
Efficient algorithms for evaluating xpath over streams

Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Massively multi-query join processing in publish/subscribe systems

Proceedings of the 2007 ACM SIGMOD international conference on Management of data
Attribute grammars for scalable query processing on XML streams

The VLDB Journal — The International Journal on Very Large Data Bases
Efficiently Querying Large XML Data Repositories: A Survey

IEEE Transactions on Knowledge and Data Engineering
Schema-based scheduling of event processors and buffer minimization for queries on structured data streams

VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
FluXQuery: an optimizing XQuery processor for streaming XML data

VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Online evaluation of regular tree queries

Nordic Journal of Computing
Inferring XML schema definitions from XML data

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
The GCX system: dynamic buffer minimization in streaming XQuery evaluation

VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Bulk data in main memory-based XQuery evaluation

XIME-P '07 Proceedings of the 4th international workshop on XQuery implementation, experience and perspectives
On-the-fly tuple selection for XQuery

XIME-P '07 Proceedings of the 4th international workshop on XQuery implementation, experience and perspectives
Learning deterministic regular expressions for the inference of schemas from XML data

Proceedings of the 17th international conference on World Wide Web
Modeling and optimization of scientific workflows

Ph.D. '08 Proceedings of the 2008 EDBT Ph.D. workshop
Semantic query optimization for processing XML streams with minimized memory footprint

DataX '08 Proceedings of the 2008 EDBT workshop on Database technologies for handling XML information on the web
StreamTX: extracting tuples from streaming XML data

Proceedings of the VLDB Endowment
Constraint-Aware XSLT Evaluation

ER '08 Proceedings of the 27th International Conference on Conceptual Modeling
Scientific workflow design for mere mortals

Future Generation Computer Systems
Simplifying XML schema: effortless handling of nondeterministic regular expressions

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Cost-Based Vectorization of Instance-Based Integration Processes

ADBIS '09 Proceedings of the 13th East European Conference on Advances in Databases and Information Systems
Worst-case optimal algorithm for XPath evaluation over XML streams

Journal of Computer and System Sciences
Inference of concise regular expressions and DTDs

ACM Transactions on Database Systems (TODS)
Parallelizing XML data-streaming workflows via MapReduce

Journal of Computer and System Sciences
Learning Deterministic Regular Expressions for the Inference of Schemas from XML Data

ACM Transactions on the Web (TWEB)
Efficient XQuery join processing in publish/subscribe systems

ADC '09 Proceedings of the Twentieth Australasian Conference on Australasian Database - Volume 92
Ambiguous content and disambiguation of XML schemata

Proceedings of the Fourteenth International Database Engineering & Applications Symposium
Cost-based vectorization of instance-based integration processes

Information Systems
Efficient evaluation of generalized tree-pattern queries on XML streams

The VLDB Journal — The International Journal on Very Large Data Bases
Complexity of Decision Problems for XML Schemas and Chain Regular Expressions

SIAM Journal on Computing
Memory lower bounds for XPath evaluation over XML streams

Journal of Computer and System Sciences
Streamable fragments of forward XPath

CIAA'11 Proceedings of the 16th international conference on Implementation and application of automata
Code transformations for one-pass analysis

LCPC'05 Proceedings of the 18th international conference on Languages and Compilers for Parallel Computing
Optimizing schema languages for XML: numerical constraints and interleaving

ICDT'07 Proceedings of the 11th international conference on Database Theory
Constraint-aware complex event pattern detection over streams

DASFAA'10 Proceedings of the 15th international conference on Database Systems for Advanced Applications - Volume Part II
A survey on XML streaming evaluation techniques

The VLDB Journal — The International Journal on Very Large Data Bases

Quantified Score

Hi-index	0.00

Visualization

Abstract

We introduce an extension of the XQuery language, FluX, that supports event-based query processing and the conscious handling of main memory buffers. Purely event-based queries of this language can be executed on streaming XML data in a very direct way. We then develop an algorithm that allows to efficiently rewrite XQueries into the event-based FluX language. This algorithm uses order constraints from a DTD to schedule event handlers and to thus minimize the amount of buffering required for evaluating a query. We discuss the various technical aspects of query optimization and query evaluation within our framework. This is complemented with an experimental evaluation of our approach.