Speedy local search for semi-supervised regularized least-squares

  • Authors:
  • Fabian Gieseke;Oliver Kramer;Antti Airola;Tapio Pahikkala

  • Affiliations:
  • Department Informatik, Carl von Ossietzky Universitat Oldenburg, Oldenburg, Germany;Department Informatik, Carl von Ossietzky Universitat Oldenburg, Oldenburg, Germany;Turku Centre for Computer Science, Department of Information Technology, University of Turku, Turku, Finland;Turku Centre for Computer Science, Department of Information Technology, University of Turku, Turku, Finland

  • Venue:
  • KI'11 Proceedings of the 34th Annual German conference on Advances in artificial intelligence
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In real-world machine learning scenarios, labeled data is often rare while unlabeled data can be obtained easily. Semi-supervised approaches aim at improving the prediction performance by taking both the labeled as well as the unlabeled part of the data into account. In particular, semi-supervised support vector machines favor decision hyperplanes which lie in a "low-density area" induced by the unlabeled patterns (while still considering the labeled part of the data). The associated optimization problem, however, is of combinatorial nature and, hence, difficult to solve. In this work, we present an efficient implementation of a simple local search strategy that is based on matrix updates of the intermediate candidate solutions. Our experiments on both artificial and real-world data sets indicate that the approach can successfully incorporate unlabeled data in an efficient manner.