On the optimal nesting order for computing N-relational joins
ACM Transactions on Database Systems (TODS)
Optimal sequencing via modular decomposition: characterization of sequencing functions
Mathematics of Operations Research
Continuous queries over append-only databases
SIGMOD '92 Proceedings of the 1992 ACM SIGMOD international conference on Management of data
Predicate migration: optimizing queries with expensive predicates
SIGMOD '93 Proceedings of the 1993 ACM SIGMOD international conference on Management of data
On the self-similar nature of Ethernet traffic (extended version)
IEEE/ACM Transactions on Networking (TON)
An overview of real-time database systems
Advances in real-time systems
Wide area traffic: the failure of Poisson modeling
IEEE/ACM Transactions on Networking (TON)
Efficient mid-query re-optimization of sub-optimal query execution plans
SIGMOD '98 Proceedings of the 1998 ACM SIGMOD international conference on Management of data
Cost-based query scrambling for initial delays
SIGMOD '98 Proceedings of the 1998 ACM SIGMOD international conference on Management of data
Memory-adaptive scheduling for large query execution
Proceedings of the seventh international conference on Information and knowledge management
Memory allocation strategies for complex decision support queries
Proceedings of the seventh international conference on Information and knowledge management
Dynamic Query Operator Scheduling for Wide-Area Remote Access
Distributed and Parallel Databases
An adaptive query execution system for data integration
SIGMOD '99 Proceedings of the 1999 ACM SIGMOD international conference on Management of data
Optimization of queries with user-defined predicates
ACM Transactions on Database Systems (TODS)
Eddies: continuously adaptive query processing
SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Hancock: a language for extracting signatures from data streams
Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining
Dataflow query execution in a parallel main-memory environment
PDIS '91 Proceedings of the first international conference on Parallel and distributed information systems
Models and issues in data stream systems
Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Rate-based query optimization for streaming information sources
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Continuously adaptive continuous queries over streams
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
The Tangram Stream Query Processing System
Proceedings of the Fifth International Conference on Data Engineering
Optimization of Nonrecursive Queries
VLDB '86 Proceedings of the 12th International Conference on Very Large Data Bases
Dynamic Pipeline Scheduling for Improving Interactive Query Performance
Proceedings of the 27th International Conference on Very Large Data Bases
SVP: A Model Capturing Sets, Lists, Streams, and Parallelism
VLDB '92 Proceedings of the 18th International Conference on Very Large Data Bases
Tribeca: A Stream Database Manager for Network Traffic Analysis
VLDB '96 Proceedings of the 22th International Conference on Very Large Data Bases
Bursty and hierarchical structure in streams
Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
Issues in data stream management
ACM SIGMOD Record
Approximate join processing over data streams
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Chain: operator scheduling for memory minimization in data stream systems
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Gigascope: a stream database for network applications
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Load Shedding for Aggregation Queries over Data Streams
ICDE '04 Proceedings of the 20th International Conference on Data Engineering
Caching queues in memory buffers
SODA '04 Proceedings of the fifteenth annual ACM-SIAM symposium on Discrete algorithms
Adaptive ordering of pipelined stream filters
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Static optimization of conjunctive queries with sliding windows over infinite streams
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Streaming queries over streaming data
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Monitoring streams: a new class of data management applications
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
SQL memory management in Oracle9i
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Load shedding in a data stream manager
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
Operator scheduling in a data stream manager
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
Update-pattern-aware modeling and processing of continuous queries
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Efficient scheduling of heterogeneous continuous queries
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
HybMig: A Hybrid Approach to Dynamic Plan Migration for Continuous Queries
IEEE Transactions on Knowledge and Data Engineering
Algorithms and metrics for processing multiple heterogeneous continuous queries
ACM Transactions on Database Systems (TODS)
Minimizing latency and memory in DSMS: a unified approach to quasi-optimal scheduling
SSPS '08 Proceedings of the 2nd international workshop on Scalable stream processing system
Modeling and exploiting query interactions in database systems
Proceedings of the 17th ACM conference on Information and knowledge management
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Exploiting the power of relational databases for efficient stream processing
Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
Efficient probabilistic event stream processing with lineage and Kleene-plus
International Journal of Communication Networks and Distributed Systems
Optimal sampling from sliding windows
Proceedings of the twenty-eighth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Class-based continuous query scheduling for data streams
Proceedings of the Sixth International Workshop on Data Management for Sensor Networks
Cost-Based Vectorization of Instance-Based Integration Processes
ADBIS '09 Proceedings of the 13th East European Conference on Advances in Databases and Information Systems
The Design of Stream Database Engine in Concurrent Environment
OTM '09 Proceedings of the Confederated International Conferences, CoopIS, DOA, IS, and ODBASE 2009 on On the Move to Meaningful Internet Systems: Part II
Resource-adaptive semantic concept detection using ensemble classifiers
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Adaptive scheduling strategy for data stream management system
APWeb/WAIM'07 Proceedings of the joint 9th Asia-Pacific web and 8th international conference on web-age information management conference on Advances in data and web management
A framework to enforce access control over data streams
ACM Transactions on Information and System Security (TISSEC)
Power-aware operator placement and broadcasting of continuous query results
Proceedings of the Ninth ACM International Workshop on Data Engineering for Wireless and Mobile Access
Cost-based vectorization of instance-based integration processes
Information Systems
Parallel processing of continuous queries over data streams
Distributed and Parallel Databases
Uncovering Global Icebergs in Distributed Streams: Results and Implications
Journal of Network and Systems Management
Multilevel secure data stream processing
DBSec'11 Proceedings of the 25th annual IFIP WG 11.3 conference on Data and applications security and privacy
Quality-driven resource-adaptive data stream mining?
ACM SIGKDD Explorations Newsletter
Interaction-aware scheduling of report-generation workloads
The VLDB Journal — The International Journal on Very Large Data Bases
Optimal sampling from sliding windows
Journal of Computer and System Sciences
Evaluation of a dynamic tree structure for indexing query regions on streaming geospatial data
SSTD'05 Proceedings of the 9th international conference on Advances in Spatial and Temporal Databases
Extensions to stream processing architecture for supporting event processing
DEXA'06 Proceedings of the 17th international conference on Database and Expert Systems Applications
Dynamic routing of data stream tuples among parallel query plan running on multi-core processors
Distributed and Parallel Databases
An optimization strategy for mashups performance based on relational algebra
APWeb'12 Proceedings of the 14th Asia-Pacific international conference on Web Technologies and Applications
MonetDB/DataCell: online analytics in a streaming column-store
Proceedings of the VLDB Endowment
Enhanced stream processing in a DBMS kernel
Proceedings of the 16th International Conference on Extending Database Technology
Data stream processing with concurrency control
ACM SIGAPP Applied Computing Review
Active workflow system for near real-time extreme-scale science
Proceedings of the first workshop on Parallel programming for analytics applications
Multilevel secure data stream processing: Architecture and implementation
Journal of Computer Security - DBSec 2011
Hi-index | 0.00 |
In many applications involving continuous data streams, data arrival is bursty and data rate fluctuates over time. Systems that seek to give rapid or real-time query responses in such an environment must be prepared to deal gracefully with bursts in data arrival without compromising system performance. We discuss one strategy for processing bursty streams - adaptive, load-aware scheduling of query operators to minimize resource consumption during times of peak load. We show that the choice of an operator scheduling strategy can have significant impact on the runtime system memory usage as well as output latency. Our aim is to design a scheduling strategy that minimizes the maximum runtime system memory while maintaining the output latency within prespecified bounds. We first present Chain scheduling, an operator scheduling strategy for data stream systems that is near-optimal in minimizing runtime memory usage for any collection of single-stream queries involving selections, projections, and foreign-key joins with stored relations. Chain scheduling also performs well for queries with sliding-window joins over multiple streams and multiple queries of the above types. However, during bursts in input streams, when there is a buildup of unprocessed tuples, Chain scheduling may lead to high output latency. We study the online problem of minimizing maximum runtime memory, subject to a constraint on maximum latency. We present preliminary observations, negative results, and heuristics for this problem. A thorough experimental evaluation is provided where we demonstrate the potential benefits of Chain scheduling and its different variants, compare it with competing scheduling strategies, and validate our analytical conclusions.