SAKM: Self-adaptive kernel machine A kernel-based algorithm for online clustering

  • Authors:
  • Habiboulaye Amadou Boubacar;Stéphane Lecoeuche;Salah Maouche

  • Affiliations:
  • Ecole des Mines de Douai, Département Informatique et Automatique, 941, Rue Charles Bourseul, BP838, 59 508 Douai, France and Laboratoire Automatique, Génie Informatique et Signal, UMR C ...;Ecole des Mines de Douai, Département Informatique et Automatique, 941, Rue Charles Bourseul, BP838, 59 508 Douai, France and Laboratoire Automatique, Génie Informatique et Signal, UMR C ...;Laboratoire Automatique, Génie Informatique et Signal, UMR CNRS 8146, Université des Sciences et Technologies de Lille, Bítiment P2, 59655 Villeneuve d'Ascq, France

  • Venue:
  • Neural Networks
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a new online clustering algorithm called SAKM (Self-Adaptive Kernel Machine) which is developed to learn continuously evolving clusters from non-stationary data. Based on SVM and kernel methods, the SAKM algorithm uses a fast adaptive learning procedure to take into account variations over time. Dedicated to online clustering in a multi-class environment, the algorithm designs an unsupervised neural architecture with self-adaptive abilities. Based on a specific kernel-induced similarity measure, the SAKM learning procedures consist of four main stages: Creation, Adaptation, Fusion and Elimination. In addition to these properties, the SAKM algorithm is attractive to be computationally efficient in online learning of real-drifting targets. After a theoretical study of the error convergence bound of the SAKM local learning, a comparison with NORMA and ALMA algorithms is made. In the end, some experiments conducted on simulation data, UCI benchmarks and real data are given to illustrate the capacities of the SAKM algorithm for online clustering in non-stationary and multi-class environment.