On computing correlated aggregates over continual data streams
SIGMOD '01 Proceedings of the 2001 ACM SIGMOD international conference on Management of data
Surfing Wavelets on Streams: One-Pass Summaries for Approximate Aggregate Queries
Proceedings of the 27th International Conference on Very Large Data Bases
Approximate join processing over data streams
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Aurora: a data stream management system
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Aurora: a new model and architecture for data stream management
The VLDB Journal — The International Journal on Very Large Data Bases
Monitoring streams: a new class of data management applications
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Operator scheduling in a data stream manager
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
A taxonomy for congestion control algorithms in packet switching networks
IEEE Network: The Magazine of Global Internetworking
Cost-efficient mining techniques for data streams
ACSW Frontiers '04 Proceedings of the second workshop on Australasian information security, Data Mining and Web Intelligence, and Software Internationalisation - Volume 32
Load Shedding for Aggregation Queries over Data Streams
ICDE '04 Proceedings of the 20th International Conference on Data Engineering
Caching queues in memory buffers
SODA '04 Proceedings of the fifteenth annual ACM-SIAM symposium on Discrete algorithms
Adaptive stream resource management using Kalman Filters
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Static optimization of conjunctive queries with sliding windows over infinite streams
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Exploiting k-constraints to reduce memory overhead in continuous queries over data streams
ACM Transactions on Database Systems (TODS)
Operator scheduling in data stream systems
The VLDB Journal — The International Journal on Very Large Data Bases
The VLDB Journal — The International Journal on Very Large Data Bases
Finding hot query patterns over an XQuery stream
The VLDB Journal — The International Journal on Very Large Data Bases
Semantic Approximation of Data Stream Joins
IEEE Transactions on Knowledge and Data Engineering
Adaptive sampling for sensor networks
DMSN '04 Proceeedings of the 1st international workshop on Data management for sensor networks: in conjunction with VLDB 2004
Fault-tolerance in the Borealis distributed stream processing system
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
On joining and caching stochastic streams
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
RPJ: producing fast join results on streams through rate-based optimization
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
BRAID: stream mining through group lag correlations
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Distributed operation in the Borealis stream processing engine
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Integrated resource management for data stream systems
Proceedings of the 2005 ACM symposium on Applied computing
Quality-driven evaluation of trigger conditions on streaming time series
Proceedings of the 2005 ACM symposium on Applied computing
Streaming pattern discovery in multiple time-series
VLDB '05 Proceedings of the 31st international conference on Very large data bases
Loadstar: load shedding in data stream mining
VLDB '05 Proceedings of the 31st international conference on Very large data bases
Adaptive load shedding for windowed stream joins
Proceedings of the 14th ACM international conference on Information and knowledge management
eSENSE: energy efficient stochastic sensing framework scheme for wireless sensor platforms
Proceedings of the 5th international conference on Information processing in sensor networks
Asking the right questions: model-driven optimization using probes
Proceedings of the twenty-fifth ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
Approximately detecting duplicates for streaming data using stable bloom filters
Proceedings of the 2006 ACM SIGMOD international conference on Management of data
Run-time operator state spilling for memory intensive long-running queries
Proceedings of the 2006 ACM SIGMOD international conference on Management of data
Quality-aware dstributed data delivery for continuous query services
Proceedings of the 2006 ACM SIGMOD international conference on Management of data
The CQL continuous query language: semantic foundations and query execution
The VLDB Journal — The International Journal on Very Large Data Bases
A dip in the reservoir: maintaining sample synopses of evolving datasets
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
State-slice: new paradigm of multi-query optimization of window-based stream queries
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
Load shedding in stream databases: a control-based approach
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
Window-aware load shedding for aggregation queries over data streams
VLDB '06 Proceedings of the 32nd international conference on Very large data bases
An annotation method for sensor data streams based on statistical patterns
DBA'06 Proceedings of the 24th IASTED international conference on Database and applications
Random Sampling for Continuous Streams with Arbitrary Updates
IEEE Transactions on Knowledge and Data Engineering
Optimization of media processing workflows with adaptive operator behaviors
Multimedia Tools and Applications
Warping the time on data streams
Data & Knowledge Engineering
Load shedding and distributed resource control of stream processing networks
Performance Evaluation
GrubJoin: An Adaptive, Multi-Way, Windowed Stream Join with Time Correlation-Aware CPU Load Shedding
IEEE Transactions on Knowledge and Data Engineering
MRST: an efficient monitoring technology of summarization on stream data
Journal of Computer Science and Technology
Operator scheduling in a data stream manager
VLDB '03 Proceedings of the 29th international conference on Very large data bases - Volume 29
Quality of service in stateful information filters
DMSN '06 Proceedings of the 3rd workshop on Data management for sensor networks: in conjunction with VLDB 2006
Intelligent system monitoring on large clusters
DMSN '06 Proceedings of the 3rd workshop on Data management for sensor networks: in conjunction with VLDB 2006
Memory-limited execution of windowed stream joins
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Remembrance of streams past: overload-sensitive management of archived streams
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Staying FIT: efficient load shedding techniques for distributed stream processing
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Executing stream joins on the cell processor
VLDB '07 Proceedings of the 33rd international conference on Very large data bases
Data-centric middleware for context-aware pervasive computing
Pervasive and Mobile Computing
Information Sciences: an International Journal
Load shedding in network monitoring applications
ATC'07 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference
Discovering frequent sets from data streams with CPU constraint
AusDM '07 Proceedings of the sixth Australasian conference on Data mining and analytics - Volume 70
Prefilter: predicate pushdown at streaming speeds
SSPS '08 Proceedings of the 2nd international workshop on Scalable stream processing system
Optimizing away joins on data streams
SSPS '08 Proceedings of the 2nd international workshop on Scalable stream processing system
Minimizing latency and memory in DSMS: a unified approach to quasi-optimal scheduling
SSPS '08 Proceedings of the 2nd international workshop on Scalable stream processing system
Events and streams: harnessing and unleashing their synergy!
Proceedings of the second international conference on Distributed event-based systems
Real-time, load-adaptive processing of continuous queries over data streams
Proceedings of the second international conference on Distributed event-based systems
SOLE: scalable on-line execution of continuous queries on spatio-temporal data streams
The VLDB Journal — The International Journal on Very Large Data Bases
Online mining of frequent sets in data streams with error guarantee
Knowledge and Information Systems
Runtime-Efficient Approach for Multiple Continuous Filtering in XML Message Brokers
SOFSEM '07 Proceedings of the 33rd conference on Current Trends in Theory and Practice of Computer Science
iJoin: Importance-Aware Join Approximation over Data Streams
SSDBM '08 Proceedings of the 20th international conference on Scientific and Statistical Database Management
Load Shedding in MavStream: Analysis, Implementation, and Evaluation
BNCOD '08 Proceedings of the 25th British national conference on Databases: Sharing Data, Information and Knowledge
Event-Based Compression and Mining of Data Streams
KES '08 Proceedings of the 12th international conference on Knowledge-Based Intelligent Information and Engineering Systems, Part II
Summarizing Distributed Data Streams for Storage in Data Warehouses
DaWaK '08 Proceedings of the 10th international conference on Data Warehousing and Knowledge Discovery
Anomaly-free incremental output in stream processing
Proceedings of the 17th ACM conference on Information and knowledge management
Robust network monitoring in the presence of non-cooperative traffic queries
Computer Networks: The International Journal of Computer and Telecommunications Networking
Semantics and implementation of continuous sliding window queries over data streams
ACM Transactions on Database Systems (TODS)
Adaptive load diffusion for stream joins
Proceedings of the ACM/IFIP/USENIX 2005 International Conference on Middleware
FMware: middleware for efficient filtering and matching of XML messages with local data
Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware
Proceedings of the 12th International Conference on Extending Database Technology: Advances in Database Technology
Rate-Sensitive Load Shedding in Data Stream Systems
IEICE - Transactions on Information and Systems
Selectivity-sensitive shared evaluation of multiple continuous XPath queries over XML streams
Information Sciences: an International Journal
CellJoin: a parallel stream join operator for the cell processor
The VLDB Journal — The International Journal on Very Large Data Bases
A First Step Towards Stream Reasoning
Future Internet --- FIS 2008
Load Shedding for Shared Window Join over Real-Time Data Streams
APWeb/WAIM '09 Proceedings of the Joint International Conferences on Advances in Data and Web Management
Small synopses for group-by query verification on outsourced data streams
ACM Transactions on Database Systems (TODS)
Fault Tolerant Evaluation of Continuous Selection Queries over Sensor Data
International Journal of Distributed Sensor Networks
Frequency-based load shedding over a data stream of tuples
Information Sciences: an International Journal
Incremental and Adaptive Clustering Stream Data over Sliding Window
DEXA '09 Proceedings of the 20th International Conference on Database and Expert Systems Applications
Fast likelihood search for hidden Markov models
ACM Transactions on Knowledge Discovery from Data (TKDD)
Middleware for pervasive spaces: balancing privacy and utility
Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware
A semantic approach for building pervasive spaces
Proceedings of the 6th Middleware Doctoral Symposium
A rules-based approach for configuring chains of classifiers in real-time stream mining systems
EURASIP Journal on Advances in Signal Processing
PRIDE: a data abstraction layer for large-scale 2-tier sensor networks
SECON'09 Proceedings of the 6th Annual IEEE communications society conference on Sensor, Mesh and Ad Hoc Communications and Networks
MOIR/MT: monitoring large-scale road network traffic in real-time
Proceedings of the VLDB Endowment
Scalable delivery of stream query result
Proceedings of the VLDB Endowment
Online piece-wise linear approximation of numerical streams with precision guarantees
Proceedings of the VLDB Endowment
Streams on wires: a query compiler for FPGAs
Proceedings of the VLDB Endowment
Synopsis based load shedding in XML streams
Proceedings of the 2009 EDBT/ICDT Workshops
Knowledge and Information Systems
A new look at generating multi-join continuous query plans: A qualified plan generation problem
Data & Knowledge Engineering
On-line predictive load shedding for network monitoring
NETWORKING'07 Proceedings of the 6th international IFIP-TC6 conference on Ad Hoc and sensor networks, wireless networks, next generation internet
Flexible selection of wavelet coefficients based on the estimation error of predefined queries
PAKDD'07 Proceedings of the 2007 international conference on Emerging technologies in knowledge discovery and data mining
Clustersheddy: load shedding using moving clusters over spatio-temporal data streams
DASFAA'07 Proceedings of the 12th international conference on Database systems for advanced applications
Event-based lossy compression for effective and efficient OLAP over data streams
Data & Knowledge Engineering
Proceedings of the ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Middleware for pervasive spaces: balancing privacy and utility
Middleware'09 Proceedings of the ACM/IFIP/USENIX 10th international conference on Middleware
Distributed resource allocation for synchronous fork and join processing networks
INFOCOM'10 Proceedings of the 29th conference on Information communications
Online discovery and maintenance of time series motifs
Proceedings of the 16th ACM SIGKDD international conference on Knowledge discovery and data mining
Tuning QoD in stream processing engines
ADC '10 Proceedings of the Twenty-First Australasian Conference on Database Technologies - Volume 104
Processing exact results for sliding window joins over data streams using disk storage
International Journal of Intelligent Information and Database Systems
Fast Discovery of Group Lag Correlations in Streams
ACM Transactions on Knowledge Discovery from Data (TKDD)
Adaptive query processing in data stream management systems under limited memory resources
PIKM '10 Proceedings of the 3rd workshop on Ph.D. students in information and knowledge management
Parallel processing of continuous queries over data streams
Distributed and Parallel Databases
IEEE Transactions on Image Processing
Proceedings of the VLDB Endowment
Changing flights in mid-air: a model for safely modifying continuous queries
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
How soccer players would do stream joins
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Fault injection-based assessment of partial fault tolerance in stream processing applications
Proceedings of the 5th ACM international conference on Distributed event-based system
Multilevel secure data stream processing
DBSec'11 Proceedings of the 25th annual IFIP WG 11.3 conference on Data and applications security and privacy
Predictive resource management of multiple monitoring applications
IEEE/ACM Transactions on Networking (TON)
UpStream: storage-centric load management for streaming applications with update semantics
The VLDB Journal — The International Journal on Very Large Data Bases
Using control theory to guide load shedding in medical data stream management system
ASIAN'05 Proceedings of the 10th Asian Computing Science conference on Advances in computer science: data management on the web
BNCOD'11 Proceedings of the 28th British national conference on Advances in databases
Buffer-preposed qos adaptation framework and load shedding techniques over streams
WISE'06 Proceedings of the 7th international conference on Web Information Systems
FMware: middleware for efficient filtering and matching of XML messages with local data
Middleware'06 Proceedings of the 7th ACM/IFIP/USENIX international conference on Middleware
Associated load shedding strategies for computing multi-joins in sensor networks
DASFAA'06 Proceedings of the 11th international conference on Database Systems for Advanced Applications
Semantic load shedding for prioritized continuous queries over data streams
ISCIS'05 Proceedings of the 20th international conference on Computer and Information Sciences
Deferred maintenance of disk-based random samples
EDBT'06 Proceedings of the 10th international conference on Advances in Database Technology
EDBT'06 Proceedings of the 10th international conference on Advances in Database Technology
EStream: online mining of frequent sets with precise error guarantee
DaWaK'06 Proceedings of the 8th international conference on Data Warehousing and Knowledge Discovery
Granularity adaptive density estimation and on demand clustering of concept-drifting data streams
DaWaK'06 Proceedings of the 8th international conference on Data Warehousing and Knowledge Discovery
Adaptive load shedding for mining frequent patterns from data streams
DaWaK'06 Proceedings of the 8th international conference on Data Warehousing and Knowledge Discovery
Control-based quality adaptation in data stream management systems
DEXA'05 Proceedings of the 16th international conference on Database and Expert Systems Applications
Distributed resource allocation in stream processing systems
DISC'06 Proceedings of the 20th international conference on Distributed Computing
Scheduling strategies and their evaluation in a data stream management system
BNCOD'06 Proceedings of the 23rd British National Conference on Databases, conference on Flexible and Efficient Information Handling
Extensions to stream processing architecture for supporting event processing
DEXA'06 Proceedings of the 17th international conference on Database and Expert Systems Applications
Adaptive load diffusion for stream joins
Middleware'05 Proceedings of the ACM/IFIP/USENIX 6th international conference on Middleware
Mining databases and data streams with query languages and rules
KDID'05 Proceedings of the 4th international conference on Knowledge Discovery in Inductive Databases
Load shedding in data stream management systems using application semantics
BNCOD'10 Proceedings of the 27th British national conference on Data Security and Security Data
Processing flows of information: From data stream to complex event processing
ACM Computing Surveys (CSUR)
Complex event processing with T-REX
Journal of Systems and Software
Revisiting formal ordering in data stream querying
Proceedings of the 27th Annual ACM Symposium on Applied Computing
An efficient overload control strategy in cloud
APWeb'12 Proceedings of the 14th international conference on Web Technologies and Applications
Highly scalable speech processing on data stream management system
DASFAA'12 Proceedings of the 17th international conference on Database Systems for Advanced Applications - Volume Part II
DBToaster: higher-order delta processing for dynamic, frequently fresh views
Proceedings of the VLDB Endowment
An embedded co-processor for accelerating window joins over uncertain data streams
Microprocessors & Microsystems
Measuring performance of complex event processing systems
TPCTC'11 Proceedings of the Third TPC Technology conference on Topics in Performance Evaluation, Measurement and Characterization
Integrating a stream processing engine and databases for persistent streaming data management
DEXA'07 Proceedings of the 18th international conference on Database and Expert Systems Applications
Towards relaxed selection and join queries over data streams
ADBIS'12 Proceedings of the 16th East European conference on Advances in Databases and Information Systems
Overcoming memory limitations in high-throughput event-based applications
Proceedings of the 4th ACM/SPEC International Conference on Performance Engineering
Input data organization for batch processing in time window based computations
Proceedings of the 28th Annual ACM Symposium on Applied Computing
Multi-query scheduling for time-critical data stream applications
Proceedings of the 25th International Conference on Scientific and Statistical Database Management
A fast handshake join implementation on FPGA with adaptive merging network
Proceedings of the 25th International Conference on Scientific and Statistical Database Management
Ariadne: managing fine-grained provenance on data streams
Proceedings of the 7th ACM international conference on Distributed event-based systems
Tutorial: stream processing optimizations
Proceedings of the 7th ACM international conference on Distributed event-based systems
QoS-aware optimization of sensor network queries
The VLDB Journal — The International Journal on Very Large Data Bases
QoS-aware placement of stream processing service
The Journal of Supercomputing
Pattern discovery in data streams under the time warping distance
The VLDB Journal — The International Journal on Very Large Data Bases
A catalog of stream processing optimizations
ACM Computing Surveys (CSUR)
Supporting distributed feed-following apps over edge devices
Proceedings of the VLDB Endowment
Realtime analysis of information diffusion in social media
Proceedings of the VLDB Endowment
Multilevel secure data stream processing: Architecture and implementation
Journal of Computer Security - DBSec 2011
Hi-index | 0.00 |
A Data Stream Manager accepts push-based inputs from a set of data sources, processes these inputs with respect to a set of standing queries, and produces outputs based on Quality-of-Service (QoS) specifications. When input rates exceed system capacity, the system will become overloaded and latency will deteriorate. Under these conditions, the system will shed load, thus degrading the answer, in order to improve the observed latency of the results. This paper examines a technique for dynamically inserting and removing drop operators into query plans as required by the current load. We examine two types of drops: the first drops a fraction of the tuples in a randomized fashion, and the second drops tuples based on the importance of their content. We address the problems of determining when load shedding is needed, where in the query plan to insert drops, and how much of the load should be shed at that point in the plan. We describe efficient solutions and present experimental evidence that they can bring the system back into the useful operating range with minimal degradation in answer quality.