Processing high-speed intelligence feeds in real-time

  • Authors:
  • Alan Demers;Johannes Gehrke;Mingsheng Hong;Mirek Riedewald

  • Affiliations:
  • Department of Computer Science, Cornell University;Department of Computer Science, Cornell University;Department of Computer Science, Cornell University;Department of Computer Science, Cornell University

  • Venue:
  • ISI'05 Proceedings of the 2005 IEEE international conference on Intelligence and Security Informatics
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Intelligence organizations face the daunting task of collecting all relevant pieces of information and to draw conclusions about potential threats in a timely manner. Typical information sources range from news tickers, financial transaction logs and message logs to satellite images and speech recordings. This wealth of data is continuously updated and arrives in high-speed data streams; it needs to be analyzed both in real-time (e.g., to estimate the importance of the information and to generate early threat alerts) and offline by sophisticated data mining tools. This work focuses on the real-time aspects of processing these massive streams of intelligence data. We also show how real-time and data mining components can interact effectively.