Learning discontinuities with products-of-sigmoids for switching between local models

  • Authors:
  • Marc Toussaint;Sethu Vijayakumar

  • Affiliations:
  • University of Edinburgh, The King's Buildings, Edinburgh, UK;University of Edinburgh, The King's Buildings, Edinburgh, UK

  • Venue:
  • ICML '05 Proceedings of the 22nd international conference on Machine learning
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Sensorimotor data from many interesting physical interactions comprises discontinuities. While existing locally weighted learning approaches aim at learning smooth functions, we propose a model that learns how to switch discontinuously between local models. The local responsibilities, usually represented by Gaussian kernels, are learned by a product of local sigmoidal classifiers that can represent complex shaped and sharply bounded regions. Local models are incrementally added. A locality prior constrains them to learn only local data---which is the key ingredient for incremental learning with local models.