Calder Query Grid Service: Insights and Experimental Evaluation

Authors:
Nithya N. Vijayakumar;Ying Liu;Beth Plale
Affiliations:
Indiana University, USA;Indiana University, USA;Indiana University, USA
Venue:
CCGRID '06 Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid
Year:
2006

Citing 0
Cited 3

Stream processing in data-driven computational science

GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
Improving data analysis through diverse data source integration

MILCOM'09 Proceedings of the 28th IEEE conference on Military communications
Towards low overhead provenance tracking in near real-time stream filtering

IPAW'06 Proceedings of the 2006 international conference on Provenance and Annotation of Data

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have architected and evaluated a new kind of data resource, one that is composed of a logical collection of ephemeral data streams that could be viewed as a collection of publish-subscribe "channels" over which rich dataaccess and semantic operations can be performed. This paper contributes new insight to stream processing under the highly asynchronous stream workloads often found in datadriven scientific applications, and presents insights gained through porting a distributed stream processing system to a Grid services framework. Experimental results reveal limits on stream processing rates that are directly tied to differences in stream rates.