Using stream queries to measure communication performance of a parallel computing environment

Authors:
Erik Zeitler;Tore Risch
Affiliations:
Uppsala University, Sweden;Uppsala University, Sweden
Venue:
ICDCSW '07 Proceedings of the 27th International Conference on Distributed Computing Systems Workshops
Year:
2007

Citing 0
Cited 2

Highly scalable trip grouping for large-scale collective transportation systems

EDBT '08 Proceedings of the 11th international conference on Extending database technology: Advances in database technology
Scalable splitting of massive data streams

DASFAA'10 Proceedings of the 15th international conference on Database Systems for Advanced Applications - Volume Part II

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have developed a data stream management system that supports declarative stream queries running over high data volumes in a supercomputing environment. To enable specification of massively parallel computations our query language provides processes as query language objects. The queries call process construction functions that execute stream sub-queries assigned to a CPU. Such queries can be used to define query functions that parallelize computations. The CPU assignment is normally automatic, but can also be influenced by the user. We show how this enables performance measurements of different communication topologies in a heterogeneous hardware environment containing a Linux cluster and a BlueGene.