On-line learning in changing environments with applications in supervised and unsupervised learning

  • Authors:
  • Noboru Murata;Motoaki Kawanabe;Andreas Ziehe;Klaus-Robert Müller;Shun-ichi Amari

  • Affiliations:
  • School of Science and Engineering, Waseda University, Tokyo, Japan;Fraunhofer FIRST, Kekuléstr. 7, 12489 Berlin, Germany;Fraunhofer FIRST, Kekuléstr. 7, 12489 Berlin, Germany;Fraunhofer FIRST, Kekuléstr. 7, 12489 Berlin, Germany and Department of Computer Science, University of Potsdam, August-Bebelstr. 89, Haus 4, 14482 Potsdam, Germany;RIKEN Brain Science Institute, Saitama, Japan

  • Venue:
  • Neural Networks - Computational models of neuromodulation
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

An adaptive on-line algorithm extending the learning of learning idea is proposed and theoretically motivated. Relying only on gradient flow information it can be applied to learning continuous functions or distributions, even when no explicit loss function is given and the Hessian is not available. The framework is applied for unsupervised and supervised learning. Its efficiency is demonstrated for drifting and switching non-stationary blind separation tasks of acoustic signals. Furthermore applications to classification (US postal service data set) and time-series prediction in changing environments are presented.