GATES: A Grid-Based Middleware for Processing Distributed Data Streams

Authors:
Liang Chen;Kolagatla Reddy;Gagan Agrawal
Affiliations:
Ohio State University, Columbus OH;Ohio State University, Columbus OH;Ohio State University, Columbus OH
Venue:
HPDC '04 Proceedings of the 13th IEEE International Symposium on High Performance Distributed Computing
Year:
2004

Citing 0
Cited 29

Resource allocation in a middleware for streaming data

MGC '04 Proceedings of the 2nd workshop on Middleware for grid computing
StreamGlobe: adaptive query processing and optimization in streaming P2P environments

DMSN '04 Proceeedings of the 1st international workshop on Data management for sensor networks: in conjunction with VLDB 2004
Evaluation of Rate-Based Adaptivity in Asynchronous Data Stream Joins

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Papers - Volume 01
Supporting dynamic migration in tightly coupled grid applications

Proceedings of the 2006 ACM/IEEE conference on Supercomputing
Supporting fault-tolerance in streaming grid applications

Proceedings of the 12th ACM SIGPLAN symposium on Principles and practice of parallel programming
Framework for bringing data streams to the grid

Scientific Programming - AxGrids 2004
Scalability of fork/join queueing networks with blocking

Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
GridRod: a dynamic runtime scheduler for grid workflows

Proceedings of the 21st annual international conference on Supercomputing
Load shedding and distributed resource control of stream processing networks

Performance Evaluation
A Vision for Cyberinfrastructure for Coastal Forecasting and Change Analysis

GeoSensor Networks
Sharpness: A Tight Condition for Scalability

SIROCCO '08 Proceedings of the 15th international colloquium on Structural Information and Communication Complexity
Challenges in dependable internet-scale stream processing

Proceedings of the 2nd workshop on Dependable distributed data management
Synergy: sharing-aware component composition for distributed stream processing systems

Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware
A reputation-driven scheduler for autonomic and sustainable resource sharing in Grid computing

Journal of Parallel and Distributed Computing
How distributed data mining tasks can thrive as knowledge services

Communications of the ACM
Flexible streaming infrastructure for UNICORE

Euro-Par'07 Proceedings of the 2007 conference on Parallel processing
Research issues in mining multiple data streams

Proceedings of the First International Workshop on Novel Data Stream Pattern Mining Techniques
Describing data with the support vector shell in distributed environments

ICDM'10 Proceedings of the 10th industrial conference on Advances in data mining: applications and theoretical aspects
Resource allocation for multiple concurrent in-network stream-processing applications

Euro-Par'09 Proceedings of the 2009 international conference on Parallel processing
Supporting self-adaptation in streaming data mining applications

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
A generic parallel processing model for facilitating data mining and integration

Parallel Computing
Decentralized management of bi-modal network resources in a distributed stream processing platform

Journal of Parallel and Distributed Computing
Resource allocation for multiple concurrent in-network stream-processing applications

Parallel Computing
Synergy: sharing-aware component composition for distributed stream processing systems

Middleware'06 Proceedings of the 7th ACM/IFIP/USENIX international conference on Middleware
Supporting a real-time distributed intrusion detection application on GATES

Euro-Par'06 Proceedings of the 12th international conference on Parallel Processing
Evaluating DHT-Based service placement for stream-based overlays

IPTPS'05 Proceedings of the 4th international conference on Peer-to-Peer Systems
Towards low overhead provenance tracking in near real-time stream filtering

IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data
QoS-aware placement of stream processing service

The Journal of Supercomputing
Cloudy: heterogeneous middleware for in time queries processing

Proceedings of the 17th International Database Engineering & Applications Symposium

Quantified Score

Hi-index	0.02

Visualization

Abstract

Increasingly, a number of applications rely on, or can potentially benefit from, analysis and monitoring of data streams.Moreover, many of these applications involve high volume data streams and require distributed processing of data arising from a distributed set of sources.Thus, we believe that a grid environment is well suited for flexible and adaptive analysis of these streams. This paper reports the design and initial evaluation of a middleware for processing distributed data streams. Our system is referred to as GATES (Grid-based AdapTive Execution on Streams).This system is designed to use the existing grid standards and tools to the extent possible.It flexibly achieves the best accuracy that is possible while maintaining the real-time constraint on the analysis.We have developed a self-adaptation algorithm for this purpose. Results from a detailed evaluation of this system demonstrate the benefits of distributed processing, and the effectiveness of our self-adaptation algorithm.