Semi-supervised learning with nuclear norm regularization

  • Authors:
  • Fanhua Shang;L. C. Jiao;Yuanyuan Liu;Hanghang Tong

  • Affiliations:
  • Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education of China, Xidian University, Xi'an 710071, China;Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education of China, Xidian University, Xi'an 710071, China;Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education of China, Xidian University, Xi'an 710071, China;Department of Computer Science City College, City University of New York, NY 10031, USA

  • Venue:
  • Pattern Recognition
  • Year:
  • 2013

Quantified Score

Hi-index 0.01

Visualization

Abstract

Integrating new knowledge sources into various learning tasks to improve their performance has recently become an interesting topic. In this paper we propose a novel semi-supervised learning (SSL) approach, called semi-supervised learning with nuclear norm regularization (SSL-NNR), which can simultaneously handle both sparse labeled data and additional pairwise constraints together with unlabeled data. Specifically, we first construct a unified SSL framework to combine the manifold assumption and the pairwise constraints assumption for classification tasks. Then we provide a modified fixed point continuous algorithm to learn a low-rank kernel matrix that takes advantage of Laplacian spectral regularization. Finally, we develop a two-stage optimization strategy, and present a semi-supervised classification algorithm with enhanced spectral kernel (ESK). Moreover, we also present a theoretical analysis of the proposed ESK algorithm, and derive an easy approach to extend it to out-of-sample data. Experimental results on a variety of synthetic and real-world data sets demonstrate the effectiveness of the proposed ESK algorithm.