Incremental stream processing using computational conflict-free replicated data types

  • Authors:
  • David Navalho;Sérgio Duarte;Nuno Preguiça;Marc Shapiro

  • Affiliations:
  • CITI/DI - FCT - Universidade Nova de Lisboa;CITI/DI - FCT - Universidade Nova de Lisboa;CITI/DI - FCT - Universidade Nova de Lisboa;LIP6 & INRIA

  • Venue:
  • Proceedings of the 3rd International Workshop on Cloud Data and Platforms
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Information has become a key commodity for most service providers. Analyzing streams of data efficiently, in real time, has become increasingly more important for supporting new products and applications. This paper outlines a novel abstraction for performing incremental stream processing based on Computational Conflict-free Replicated Data Types. C-CRDTs are replicated objects that can be updated concurrently without coordination to perform a computation and still converge to a consistent state that reflects all contributions. Results obtained with a preliminary prototype show that C-CRDTs have the potential to match and improve computational throughput when compared with a state of the art stream processing system.