Effective pruning strategies for sequential pattern mining

  • Authors:
  • Xu Yusheng;Ma Zhixin;Li Lian;Tharam S. Dillon

  • Affiliations:
  • Lanzhou University, China;Lanzhou University, China;Lanzhou University, China;Curtin University, Perth, Australia

  • Venue:
  • Proceedings of the 1st international conference on Forensic applications and techniques in telecommunications, information, and multimedia and workshop
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we systematically explore the search space of frequent sequence mining and present two novel pruning strategies, SEP (Sequence Extension Pruning) and IEP (Item Extension Pruning), which can be used in all Apriori-like sequence mining algorithms or lattice-theoretic approaches. With a little more memory overhead, proposed pruning strategies can prune invalidated search space and decrease the total cost of frequency counting effectively. For effectiveness testing reason, we optimize SPAM [2] and present the improved algorithm, SPAMSEPIPE, which uses SEP and IEP to prune the search space by sharing the frequent 2-sequences lists. A set of comprehensive performance experiments study shows that SPAMSEPIEP outperforms SPAM by a factor of 10 on small datasets and better than 30% to 50% on reasonably large dataset.