Approximate Frequent Itemset Discovery from Data Stream

  • Authors:
  • Anna Ciampi;Fabio Fumarola;Annalisa Appice;Donato Malerba

  • Affiliations:
  • Dipartimento di Informatica, Università degli Studi di Bari, Bari, Italy 70126;Dipartimento di Informatica, Università degli Studi di Bari, Bari, Italy 70126;Dipartimento di Informatica, Università degli Studi di Bari, Bari, Italy 70126;Dipartimento di Informatica, Università degli Studi di Bari, Bari, Italy 70126

  • Venue:
  • AI*IA '09: Proceedings of the XIth International Conference of the Italian Association for Artificial Intelligence Reggio Emilia on Emergent Perspectives in Artificial Intelligence
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Traditional algorithms for frequent itemset discovery are designed for static data. They cannot be straightforwardly applied to data streams which are continuous, unbounded, usually coming at high speed and often with a data distribution which changes with time. The main challenges of frequent pattern mining in data streams are: avoiding multiple scans of the entire dataset, optimizing memory usage and capturing distribution drift. To face these challenges, we propose a novel algorithm, which is based on a sliding window model in order to deal with efficiency issues and to keep up with distribution change. Each window consists of several slides. The generation of itemsets is local to each slide, while the estimation of their approximate support is based on the window. Efficiency in the generation of the itemsets is ensured by the usage of a synopsis structure, called SE-tree. Experiments prove the effectiveness of the proposed algorithm.