Processing high data rate streams in System S

  • Authors:
  • H. Andrade;B. Gedik;K. -L. Wu;P. S. Yu

  • Affiliations:
  • IBM Thomas J. Watson Research Center, Hawthorne, NY, 10532, United States;IBM Thomas J. Watson Research Center, Hawthorne, NY, 10532, United States;IBM Thomas J. Watson Research Center, Hawthorne, NY, 10532, United States;Department of Computer Science, University of Illinois, Chicago, IL, 60607, United States

  • Venue:
  • Journal of Parallel and Distributed Computing
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

High-performance stream processing is critical in many sense-and-respond application domains-from environmental monitoring to algorithmic trading. In this paper, we focus on language and runtime support for improving the performance of sense-and-respond applications in processing data from high-rate live streams. The central tenets of this work are the programming model, the workload splitting mechanisms, the code generation framework, and the underlying System S middleware and Spade programming model. We demonstrate considerable scalability behavior coupled with low processing latency in a real-world financial trading application.