MMFI_DSSW: a new method to incrementally mine maximal frequent itemsets in transaction sensitive sliding window

  • Authors:
  • Jiayin Feng;Jiadong Ren

  • Affiliations:
  • College of Information Science and Engineering, Yanshan University, QinHuangdao, China;College of Information Science and Engineering, Yanshan University, QinHuangdao, China

  • Venue:
  • KSEM'07 Proceedings of the 2nd international conference on Knowledge science, engineering and management
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Due to streaming data are infinite in length and fast changing with time, it is very significant to limit the memory usage in the process of mining data streams. Maximal frequent itemset is a subset of frequent itemsets; it can represent the important information of frequent itemsets with low computational cost. In this paper, we propose an algorithm MMFI-DSSW (Mining Maximal Frequent Itemsets in Data Streams SlidingWindow) to mine maximal frequent itemsets with a novel MFI-BVT (Maximal Frequent Itemsets Binary Vector Table) summary data structure in sliding window. MFI-BVT builds a binary vector for each itemsets first. Then algorithm MMFI DSSW performs logical AND operation to mine all the maximal frequent itemsets in MFI-BVT with a single-pass scan incoming data. Finally, the mining result can be updated incrementally. Experiment shows that algorithm MMFI-DSSW is efficient and scalable in memory usage and running time of CPU.