ACDN: a content delivery network for applications
Proceedings of the 2002 ACM SIGMOD international conference on Management of data
Pastry: Scalable, Decentralized Object Location, and Routing for Large-Scale Peer-to-Peer Systems
Middleware '01 Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms Heidelberg
An Automated Profiling Subsystem for QoS-Aware Services
RTAS '00 Proceedings of the Sixth IEEE Real Time Technology and Applications Symposium (RTAS 2000)
PeerCQ: A Decentralized and Self-Configuring Peer-to-Peer Information Monitoring System
ICDCS '03 Proceedings of the 23rd International Conference on Distributed Computing Systems
A Distributed Approach to Topology-Aware Overlay Path Monitoring
ICDCS '04 Proceedings of the 24th International Conference on Distributed Computing Systems (ICDCS'04)
IEEE/ACM Transactions on Networking (TON)
SpiderNet: An Integrated Peer-to-Peer Service Composition Framework
HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
GATES: A Grid-Based Middleware for Processing Distributed Data Streams
HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
Composition of coordinated web services
Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware
A Comparative Evaluation of Transparent Scaling Techniques for Dynamic Content Servers
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Dynamic Load Distribution in the Borealis Stream Processor
ICDE '05 Proceedings of the 21st International Conference on Data Engineering
Coordinated Media Streaming and Transcoding in Peer-to-Peer Systems
IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Update-pattern-aware modeling and processing of continuous queries
Proceedings of the 2005 ACM SIGMOD international conference on Management of data
Optimal Component Composition for Scalable Stream Processing
ICDCS '05 Proceedings of the 25th IEEE International Conference on Distributed Computing Systems
Resource-Aware Distributed Stream Management Using Dynamic Overlays
ICDCS '05 Proceedings of the 25th IEEE International Conference on Distributed Computing Systems
Network-Aware Operator Placement for Stream-Processing Systems
ICDE '06 Proceedings of the 22nd International Conference on Data Engineering
Design, implementation, and evaluation of the linear road bnchmark on the stream processing core
Proceedings of the 2006 ACM SIGMOD international conference on Management of data
Exploiting internet route sharing for large scale available bandwidth estimation
IMC '05 Proceedings of the 5th ACM SIGCOMM conference on Internet Measurement
Design and implementation tradeoffs for wide-area resource discovery
HPDC '05 Proceedings of the High Performance Distributed Computing, 2005. HPDC-14. Proceedings. 14th IEEE International Symposium
INFOCOM'96 Proceedings of the Fifteenth annual joint conference of the IEEE computer and communications societies conference on The conference on computer communications - Volume 2
A scalable framework for the support of advanced edge services
HPCC'05 Proceedings of the First international conference on High Performance Computing and Communications
The gridkit distributed resource management framework
EGC'05 Proceedings of the 2005 European conference on Advances in Grid Computing
Using dynamic configuration to manage a scalable multimedia distribution system
Computer Communications
Storage optimization for large-scale distributed stream-processing systems
ACM Transactions on Storage (TOS)
Replica placement for high availability in distributed stream processing systems
Proceedings of the second international conference on Distributed event-based systems
Biologically-inspired distributed middleware management for stream processing systems
Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware
Toward massive query optimization in large-scale distributed stream systems
Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware
CLASP: collaborating, autonomous stream processing systems
Proceedings of the ACM/IFIP/USENIX 2007 International Conference on Middleware
Towards efficient event aggregation in a decentralized publish-subscribe system
Proceedings of the Third ACM International Conference on Distributed Event-Based Systems
CLASP: collaborating, autonomous stream processing systems
MIDDLEWARE2007 Proceedings of the 8th ACM/IFIP/USENIX international conference on Middleware
Processing flows of information: From data stream to complex event processing
ACM Computing Surveys (CSUR)
Dynamic instance queuing in process-aware information systems
Proceedings of the 28th Annual ACM Symposium on Applied Computing
Efficient event detection by exploiting crowds
Proceedings of the 7th ACM international conference on Distributed event-based systems
| Hi-index | 0.01 |
Many emerging on-line data analysis applications require applying continuous query operations such as correlation, aggregation, and filtering to data streams in real-time. Distributed stream processing systems allow in-network stream processing to achieve better scalability and quality-of-service (QoS) provision. In this paper we present Synergy, a distributed stream processing middleware that provides sharing-aware component composition. Synergy enables efficient reuse of both data streams and processing components, while composing distributed stream processing applications with QoS demands. Synergy provides a set of fully distributed algorithms to discover and evaluate the reusability of available data streams and processing components when instantiating new stream applications. For QoS provision, Synergy performs QoS impact projection to examine whether the shared processing can cause QoS violations on currently running applications. We have implemented a prototype of the Synergy middleware and evaluated its performance on both PlanetLab and simulation testbeds. The experimental results show that Synergy can achieve much better resource utilization and QoS provision than previously proposed schemes, by judiciously sharing streams and processing components during application composition.