Deep learning via semi-supervised embedding

  • Authors:
  • Jason Weston;Frédéric Ratle;Ronan Collobert

  • Affiliations:
  • NEC Labs America, Princeton, NJ;University of Lausanne, Lausanne, Switzerland;NEC Labs America, Princeton, NJ

  • Venue:
  • Proceedings of the 25th international conference on Machine learning
  • Year:
  • 2008

Quantified Score

Hi-index 0.02

Visualization

Abstract

We show how nonlinear embedding algorithms popular for use with shallow semi-supervised learning techniques such as kernel methods can be applied to deep multilayer architectures, either as a regularizer at the output layer, or on each layer of the architecture. This provides a simple alternative to existing approaches to deep learning whilst yielding competitive error rates compared to those methods, and existing shallow semi-supervised techniques.