Programming expert systems in OPS5: an introduction to rule-based programming
Programming expert systems in OPS5: an introduction to rule-based programming
STREAM: the stanford stream data manager (demonstration description)
Proceedings of the 2003 ACM SIGMOD international conference on Management of data
Aurora: a new model and architecture for data stream management
The VLDB Journal — The International Journal on Very Large Data Bases
Monitoring streams: a new class of data management applications
VLDB '02 Proceedings of the 28th international conference on Very Large Data Bases
Linear road: a stream data management benchmark
VLDB '04 Proceedings of the Thirtieth international conference on Very large data bases - Volume 30
Multi-site cooperative data stream analysis
ACM SIGOPS Operating Systems Review
Computer
A practical approach for enabling online analysis of event streams
Proceedings of the 2007 inaugural international conference on Distributed event-based systems
Streamflex: high-throughput stream programming in java
Proceedings of the 22nd annual ACM SIGPLAN conference on Object-oriented programming systems and applications
Storage optimization for large-scale distributed stream-processing systems
ACM Transactions on Storage (TOS)
Hyperion: high volume stream archival for retrospective querying
ATC'07 2007 USENIX Annual Technical Conference on Proceedings of the USENIX Annual Technical Conference
BFSiena: a communication substrate for StreamMine
Proceedings of the second international conference on Distributed event-based systems
Stream processing in data-driven computational science
GRID '06 Proceedings of the 7th IEEE/ACM International Conference on Grid Computing
CLASP: collaborating, autonomous stream processing systems
Proceedings of the ACM/IFIP/USENIX 2007 International Conference on Middleware
Time-bounded distributed QoS-aware service configuration in heterogeneous cooperative environments
Journal of Parallel and Distributed Computing
Window Update Patterns in Stream Operators
ADBIS '09 Proceedings of the 13th East European Conference on Advances in Databases and Information Systems
CLASP: collaborating, autonomous stream processing systems
MIDDLEWARE2007 Proceedings of the 8th ACM/IFIP/USENIX international conference on Middleware
An MPI-Stream Hybrid Programming Model for Computational Clusters
CCGRID '10 Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing
DEFCON: high-performance event processing with information security
USENIXATC'10 Proceedings of the 2010 USENIX conference on USENIX annual technical conference
FPGA-based adaptive computing for correlated multi-stream processing
Proceedings of the Conference on Design, Automation and Test in Europe
DBOD-DS: distance based outlier detection for data
DEXA'10 Proceedings of the 21st international conference on Database and expert systems applications: Part I
Database theory: query languages
Algorithms and theory of computation handbook
Fault injection-based assessment of partial fault tolerance in stream processing applications
Proceedings of the 5th ACM international conference on Distributed event-based system
Flow: A Stream Processing System Simulator
PADS '10 Proceedings of the 2010 IEEE Workshop on Principles of Advanced and Distributed Simulation
Subsuming multiple sliding windows for shared stream computation
ADBIS'11 Proceedings of the 15th international conference on Advances in databases and information systems
Online outlier detection for data streams
Proceedings of the 15th Symposium on International Database Engineering & Applications
Parallel processing on real-time gesture recognition system
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
Understanding and improving the cost of scaling distributed event processing
Proceedings of the 6th ACM International Conference on Distributed Event-Based Systems
Event processing of monitoring data of large hi-tech manufacturing equipment: DEBS grand challenge
Proceedings of the 6th ACM International Conference on Distributed Event-Based Systems
High performance mining of social media data
Proceedings of the 1st Conference of the Extreme Science and Engineering Discovery Environment: Bridging from the eXtreme to the campus and beyond
Proceedings of the WICSA/ECSA 2012 Companion Volume
Enlister: baidu's recommender system for the biggest chinese Q&A website
Proceedings of the sixth ACM conference on Recommender systems
Multi-scale windowing over trajectory streams
ER'12 Proceedings of the 2012 international conference on Advances in Conceptual Modeling
Predictive analytics with surveillance big data
Proceedings of the 1st ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data
Database support for processing complex aggregate queries over data streams
Proceedings of the Joint EDBT/ICDT 2013 Workshops
Proceedings of the 7th ACM international conference on Distributed event-based systems
StreamRule: a nonmonotonic stream reasoning system for the semantic web
RR'13 Proceedings of the 7th international conference on Web Reasoning and Rule Systems
MillWheel: fault-tolerant stream processing at internet scale
Proceedings of the VLDB Endowment
Research issues in outlier detection for data streams
ACM SIGKDD Explorations Newsletter
Hi-index | 0.00 |
Applications that require real-time processing of high-volume data steams are pushing the limits of traditional data processing infrastructures. These stream-based applications include market feed processing and electronic trading on Wall Street, network and infrastructure monitoring, fraud detection, and command and control in military environments. Furthermore, as the "sea change" caused by cheap micro-sensor technology takes hold, we expect to see everything of material significance on the planet get "sensor-tagged" and report its state or location in real time. This sensorization of the real world will lead to a "green field" of novel monitoring and control applications with high-volume and low-latency processing requirements.Recently, several technologies have emerged---including off-the-shelf stream processing engines---specifically to address the challenges of processing high-volume, real-time data without requiring the use of custom code. At the same time, some existing software technologies, such as main memory DBMSs and rule engines, are also being "repurposed" by marketing departments to address these applications.In this paper, we outline eight requirements that a system software should meet to excel at a variety of real-time stream processing applications. Our goal is to provide high-level guidance to information technologists so that they will know what to look for when evaluation alternative stream processing solutions. As such, this paper serves a purpose comparable to the requirements papers in relational DBMSs and on-line analytical processing. We also briefly review alternative system software technologies in the context of our requirements.The paper attempts to be vendor neutral, so no specific commercial products are mentioned.