Discovering frequent sets from data streams with CPU constraint

  • Authors:
  • Xuan Hong Dang;Wee-Keong Ng;Kok-Leong Ong;Vincent C S Lee

  • Affiliations:
  • Nanyang Technological University, Singapore;Nanyang Technological University, Singapore;Deakin University, Australia;Monash University, Australia

  • Venue:
  • AusDM '07 Proceedings of the sixth Australasian conference on Data mining and analytics - Volume 70
  • Year:
  • 2007

Quantified Score

Hi-index 0.02

Visualization

Abstract

Data streams are usually generated in an online fashion characterized by huge volume, rapid unpredictable rates, and fast changing data characteristics. It has been hence recognized that mining over streaming data requires the problem of limited computational resources to be adequately addressed. Since the arrival rate of data streams can significantly increase and exceed the CPU capacity, the machinery must adapt to this change to guarantee the timeliness of the results. We present an online algorithm to approximate a set of frequent patterns from a sliding window over the underlying data stream -- given apriori CPU capacity. The algorithm automatically detects overload situations and can adaptively shed unprocessed data to guarantee the timely results. We theoretically prove, using probabilistic and deterministic techniques, that the error on the output results is bounded within a pre-specified threshold. The empirical results on various datasets also confirmed the feasiblity of our proposal.