Platform Overlays: enabling in-network stream processing in large-scale distributed applications

Authors:
Ada Gavrilovska;Sanjay Kumar;Srikanth Sundaragopalan;Karsten Schwan
Affiliations:
Georgia Institute of Technology, Atlanta, Georgia;Georgia Institute of Technology, Atlanta, Georgia;Georgia Institute of Technology, Atlanta, Georgia;Georgia Institute of Technology, Atlanta, Georgia
Venue:
NOSSDAV '05 Proceedings of the international workshop on Network and operating systems support for digital audio and video
Year:
2005

Citing 15
Cited 3

The click modular router

ACM Transactions on Computer Systems (TOCS)
Exploitng event stream interpretation in publish-subscribe systems

Proceedings of the twentieth annual ACM symposium on Principles of distributed computing
Building a robust software-based router using network processors

SOSP '01 Proceedings of the eighteenth ACM symposium on Operating systems principles
Protocol Wrappers for Layered Network Packet Processing in Reconfigurable Hardware

IEEE Micro
Can User-Level Protocols Take Advantage of Multi-CPU NICs?

IPDPS '02 Proceedings of the 16th International Parallel and Distributed Processing Symposium
Payload Caching: High-Speed Data Forwarding for Network Intermediaries

Proceedings of the General Track: 2002 USENIX Annual Technical Conference
StreamIt: A Language for Streaming Applications

CC '02 Proceedings of the 11th International Conference on Compiler Construction
High performance RDMA-based MPI implementation over InfiniBand

ICS '03 Proceedings of the 17th annual international conference on Supercomputing
Spidle: a DSL approach to specifying streaming applications

Proceedings of the 2nd international conference on Generative programming and component engineering
Towards an integrated multimedia service hosting overlay

Proceedings of the 12th annual ACM international conference on Multimedia
KStreams: kernel support for efficient data streaming in proxy servers

NOSSDAV '05 Proceedings of the international workshop on Network and operating systems support for digital audio and video
Research note: Anatomy of UDP and M-VIA for cluster communication

Journal of Parallel and Distributed Computing - Special issue: Design and performance of networks for super-, cluster-, and grid-computing: Part I
An architecture for componentized, network-based media services

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 1
Operational information systems: an example from the airline industry

WIESS'00 Proceedings of the 1st conference on Industrial Experiences with Systems Software - Volume 1
An architecture for highly available wide-area service composition

Computer Communications

Addressing data compatibility on programmable network platforms

Proceedings of the 2005 ACM symposium on Architecture for networking and communications systems
Advanced networking services for distributed multimedia streaming applications

Multimedia Tools and Applications
Foresighted tree configuration games in resource constrained distributed stream mining sensors

Ad Hoc Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

The purpose of this research is to explore the capabilities of future, multi-core heterogeneous systems, with specialized communication support, to be used as efficient and flexible execution platforms in distributed streaming applications. On such platforms, we create overlays of hardware- and software-supported execution contexts -- platform overlays. Stream manipulations, represented via stream handlers, are deployed on top of such overlays, based on the ability of individual contexts to perform handler operations. As a result, stream processing is dynamically mapped to those platform resources best suited for it, and it can even be fully contained to the networking subsystems, thereby enabling in-network stream processing. Experimental results demonstrate the benefits of our approach towards meeting application-specific quality requirements.