Management of real-time streaming data Grid services: Research Articles

Authors:
Geoffrey Fox;Galip Aydin;Hasan Bulut;Harshawardhan Gadgil;Shrideep Pallickara;Marlon Pierce;Wenjun Wu
Affiliations:
Community Grids Laboratory, Indiana University, 501 North Morton Street, Suite 224, Bloomington, IN 47404, U.S.A.;Community Grids Laboratory, Indiana University, 501 North Morton Street, Suite 224, Bloomington, IN 47404, U.S.A.;Community Grids Laboratory, Indiana University, 501 North Morton Street, Suite 224, Bloomington, IN 47404, U.S.A.;Community Grids Laboratory, Indiana University, 501 North Morton Street, Suite 224, Bloomington, IN 47404, U.S.A.;Community Grids Laboratory, Indiana University, 501 North Morton Street, Suite 224, Bloomington, IN 47404, U.S.A.;Community Grids Laboratory, Indiana University, 501 North Morton Street, Suite 224, Bloomington, IN 47404, U.S.A.;Community Grids Laboratory, Indiana University, 501 North Morton Street, Suite 224, Bloomington, IN 47404, U.S.A.
Venue:
Concurrency and Computation: Practice & Experience - Autonomous Grid Computing
Year:
2007

Citing 0
Cited 3

VLAM-G: Interactive data driven workflow engine for Grid-enabled resources

Scientific Programming
Data Transformation Services over Grids with Real-Time Bound Constraints

OTM '08 Proceedings of the OTM 2008 Confederated International Conferences, CoopIS, DOA, GADA, IS, and ODBASE 2008. Part I on On the Move to Meaningful Internet Systems:
Streamflow Programming Model for Data Streaming in Scientific Workflows

CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

We discuss our message-based approach to managing real-time data streams and building higher level services to produce and consume them. Our messaging system acts as a substrate that can be used to provide qualities of service to various streaming applications ranging from audio–video collaboration systems to sensor Grids. The messaging substrates are composed of distributed, hierarchically arranged message broker networks. Services such as filters are deployed along the edges of the network. We discuss the role of management systems for both broker networks and filter services: broker network topologies must be created and maintained, and distributed filters must be arranged in appropriate sequences. These managed broker networks may be applied to a wide range of problems. We discuss applications to audio–video collaboration in some detail and also describe applications to streaming Global Positioning System data streams. These provide specific application filters that can transform and republish message streams to the broker system. Copyright © 2006 John Wiley & Sons, Ltd.