EVIS: a fast and scalable episode matching engine for massively parallel data streams

  • Authors:
  • Shinichiro Tago;Tatsuya Asai;Takashi Katoh;Hiroaki Morikawa;Hiroya Inakoshi

  • Affiliations:
  • Fujitsu Laboratories Ltd., Kawasaki, Japan;Fujitsu Laboratories Ltd., Kawasaki, Japan;Fujitsu Laboratories Ltd., Kawasaki, Japan;Fujitsu Laboratories Ltd., Kawasaki, Japan;Fujitsu Laboratories Ltd., Kawasaki, Japan

  • Venue:
  • DASFAA'12 Proceedings of the 17th international conference on Database Systems for Advanced Applications - Volume Part II
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a fast episode pattern matching engine EVIS that detects all occurrences in massively parallel data streams for an episode pattern, which represents a collection of event types in a given partial order. There should be important applications to be addressed with this technology, such as monitoring stock price movements, and tracking vehicles or merchandise by using GPS or RFID sensors. EVIS employs a variant of non-deterministic finite automata whose states are extended to maintain their activated times and activating streams. This extension allows EVIS's episode pattern to have 1) interval constraints that enforce time-bound conditions on every pair of consequent event types in the pattern, and 2) stream constraints by which two interested series of events are associated with each other and found in arbitrary pairs of streams. The experimental results show that EVIS performs much faster than a popular CEP engine for both artificial and real world datasets, as well as that EVIS effectively works for over 100,000 streams.