Efficient resumption of interrupted warehouse loads
SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Models and issues in data stream systems
Proceedings of the twenty-first ACM SIGMOD-SIGACT-SIGART symposium on Principles of database systems
A survey of rollback-recovery protocols in message-passing systems
ACM Computing Surveys (CSUR)
Providing High Availability in Very Large Worklflow Management Systems
EDBT '96 Proceedings of the 5th International Conference on Extending Database Technology: Advances in Database Technology
Fjording the Stream: An Architecture for Queries Over Streaming Sensor Data
ICDE '02 Proceedings of the 18th International Conference on Data Engineering
Flux: An Adaptive Partitioning Operator for Continuous Query Systems
Flux: An Adaptive Partitioning Operator for Continuous Query Systems
Aurora: a new model and architecture for data stream management
The VLDB Journal — The International Journal on Very Large Data Bases
Highly available, fault-tolerant, parallel dataflows
SIGMOD '04 Proceedings of the 2004 ACM SIGMOD international conference on Management of data
Monitoring streams: a new class of data management applications
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Ibm websphere v5.0 performance, scalability, and high availability websphere handbook series
Ibm websphere v5.0 performance, scalability, and high availability websphere handbook series
"One Size Fits All": An Idea Whose Time Has Come and Gone
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Fault-tolerance in the Borealis distributed stream processing system
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Distributed operation in the Borealis stream processing engine
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Retroactive answering of search queries
Proceedings of the 15th international conference on World Wide Web
Towards correcting input data errors probabilistically using integrity constraints
MobiDE '06 Proceedings of the 5th ACM international workshop on Data engineering for wireless and mobile access
Quality-aware dstributed data delivery for continuous query services
Proceedings of the 2006 ACM SIGMOD international conference on Management of data
Multi-site cooperative data stream analysis
ACM SIGOPS Operating Systems Review
Fault-tolerance in the borealis distributed stream processing system
ACM Transactions on Database Systems (TODS)
Foundations and Trends in Databases
Borealis-R: a replication-transparent stream processing system for wide-area monitoring applications
Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Replay-based approaches to revision processing in stream query engines
SSPS '08 Proceedings of the 2nd international workshop on Scalable stream processing system
Replica placement for high availability in distributed stream processing systems
Proceedings of the second international conference on Distributed event-based systems
Challenges in dependable internet-scale stream processing
Proceedings of the 2nd workshop on Dependable distributed data management
Fault-tolerant stream processing using a distributed, replicated file system
Proceedings of the VLDB Endowment
PROQID: partial restarts of queries in distributed databases
Proceedings of the 17th ACM conference on Information and knowledge management
Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
State management and concurrency in event processing
Proceedings of the Third ACM International Conference on Distributed Event-Based Systems
An empirical study of high availability in stream processing systems
Proceedings of the 10th ACM/IFIP/USENIX International Conference on Middleware
Integration of reliable sensor data stream management into digital libraries
DELOS'07 Proceedings of the 1st international conference on Digital libraries: research and development
Detouring and replication for fast and reliable internet-scale stream processing
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Proceedings of the Fourteenth International Database Engineering & Applications Symposium
Design principles for developing stream processing applications
Software—Practice & Experience - Focus on Selected PhD Literature Reviews in the Practical Aspects of Software Technology
Proceedings of the VLDB Endowment
Reliable distributed data stream management in mobile environments
Information Systems
A latency and fault-tolerance optimizer for online parallel query plans
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
Changing flights in mid-air: a model for safely modifying continuous queries
Proceedings of the 2011 ACM SIGMOD International Conference on Management of data
In-situ MapReduce for log processing
USENIXATC'11 Proceedings of the 2011 USENIX conference on USENIX annual technical conference
Fault injection-based assessment of partial fault tolerance in stream processing applications
Proceedings of the 5th ACM international conference on Distributed event-based system
Efficient and coordinated checkpointing for reliable distributed data stream management
ADBIS'06 Proceedings of the 10th East European conference on Advances in Databases and Information Systems
In-situ MapReduce for log processing
HotCloud'11 Proceedings of the 3rd USENIX conference on Hot topics in cloud computing
Towards a secure data stream management system
TEAA'05 Proceedings of the 31st VLDB conference on Trends in Enterprise Application Architecture
Processing flows of information: From data stream to complex event processing
ACM Computing Surveys (CSUR)
Transactional stream processing
Proceedings of the 15th International Conference on Extending Database Technology
Discretized streams: an efficient and fault-tolerant model for stream processing on large clusters
HotCloud'12 Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing
Pollux: towards scalable distributed real-time search on microblogs
Proceedings of the 16th International Conference on Extending Database Technology
TimeStream: reliable stream computation in the cloud
Proceedings of the 8th ACM European Conference on Computer Systems
Rollback-recovery without checkpoints in distributed event processing systems
Proceedings of the 7th ACM international conference on Distributed event-based systems
Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles
ACM SIGOPS 24th Symposium on Operating Systems Principles
Discretized streams: fault-tolerant streaming computation at scale
Proceedings of the Twenty-Fourth ACM Symposium on Operating Systems Principles
MillWheel: fault-tolerant stream processing at internet scale
Proceedings of the VLDB Endowment
Proceedings Demo & Poster Track of ACM/IFIP/USENIX International Middleware Conference
| Hi-index | 0.00 |
Stream-processing systems are designed to support an emerging class of applications that require sophisticated and timely processing of high-volume data streams, often originating in distributed environments. Unlike traditional data-processing applications that require precise recovery for correctness, many stream-processing applications can tolerate and benefit from weaker recovery guarantees. In this paper, we study various recovery guarantees and pertinent recovery techniques that can meet the correctness and performance requirements of stream-processing applications. We discuss the design and algorithmic challenges associated with the proposed recovery techniques and describe how each can provide different guarantees with proper combinations of redundant processing, checkpointing, and remote logging. Using analysis and simulations, we quantify the cost of our recovery guarantees and examine the performance and applicability of the recovery techniques. We also analyze how the knowledge of query network properties can help decrease the cost of high availability.