Complexity versus agreement for many views: co-regularization for multi-view semi-supervised learning

  • Authors:
  • Odalric-Ambrym Maillard;Nicolas Vayatis

  • Affiliations:
  • Sequential Learning Project, INRIA Lille-Nord Europe, France;ENS Cachan & UniverSud, CMLA, UMR, CNRS

  • Venue:
  • ALT'09 Proceedings of the 20th international conference on Algorithmic learning theory
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

The paper considers the problem of semi-supervised multiview classification, where each view corresponds to a Reproducing Kernel Hilbert Space. An algorithm based on co-regularization methods with extra penalty terms reflecting smoothness and general agreement properties is proposed. We first provide explicit tight control on the Rademacher (L1) complexity of the corresponding class of learners for arbitrary many views, then give the asymptotic behavior of the bounds when the coregularization term increases, making explicit the relation between consistency of the views and reduction of the search space. Since many views involve many parameters, we third provide a parameter selection procedure, based on the stability approach with clustering and localization arguments. To this aim, we give an explicit bound on the variance (L2- diameter) of the class of functions. Finally we illustrate the algorithm through simulations on toy examples.