Direct local pattern sampling by efficient two-step random procedures

  • Authors:
  • Mario Boley;Claudio Lucchese;Daniel Paurat;Thomas Gärtner

  • Affiliations:
  • Fraunhofer IAIS and University of Bonn, Sankt Augustin, Germany;I.S.T.I.-C.N.R. Pisa , Pisa, Italy;Fraunhofer IAIS and University of Bonn, Sankt Augustin, Germany;Fraunhofer IAIS and University of Bonn, Sankt Augustin, Germany

  • Venue:
  • Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present several exact and highly scalable local pattern sampling algorithms. They can be used as an alternative to exhaustive local pattern discovery methods (e.g, frequent set mining or optimistic-estimator-based subgroup discovery) and can substantially improve efficiency as well as controllability of pattern discovery processes. While previous sampling approaches mainly rely on the Markov chain Monte Carlo method, our procedures are direct, i.e., non process-simulating, sampling algorithms. The advantages of these direct methods are an almost optimal time complexity per pattern as well as an exactly controlled distribution of the produced patterns. Namely, the proposed algorithms can sample (item-)sets according to frequency, area, squared frequency, and a class discriminativity measure. Experiments demonstrate that these procedures can improve the accuracy of pattern-based models similar to frequent sets and often also lead to substantial gains in terms of scalability.