Semi-supervised classification based on random subspace dimensionality reduction

  • Authors:
  • Guoxian Yu;Guoji Zhang;Carlotta Domeniconi;Zhiwen Yu;Jane You

  • Affiliations:
  • School of Computer Science and Engineering, South China University of Technology, Guangzhou 510006, China;School of Sciences, South China University of Technology, Guangzhou 510640, China;Department of Computer Science, George Mason University, Fairfax, VA 22030, USA;School of Computer Science and Engineering, South China University of Technology, Guangzhou 510006, China and Department of Computing, Hong Kong Polytechnic University, Hong Kong;Department of Computing, Hong Kong Polytechnic University, Hong Kong

  • Venue:
  • Pattern Recognition
  • Year:
  • 2012

Quantified Score

Hi-index 0.01

Visualization

Abstract

Graph structure is vital to graph based semi-supervised learning. However, the problem of constructing a graph that reflects the underlying data distribution has been seldom investigated in semi-supervised learning, especially for high dimensional data. In this paper, we focus on graph construction for semi-supervised learning and propose a novel method called Semi-Supervised Classification based on Random Subspace Dimensionality Reduction, SSC-RSDR in short. Different from traditional methods that perform graph-based dimensionality reduction and classification in the original space, SSC-RSDR performs these tasks in subspaces. More specifically, SSC-RSDR generates several random subspaces of the original space and applies graph-based semi-supervised dimensionality reduction in these random subspaces. It then constructs graphs in these processed random subspaces and trains semi-supervised classifiers on the graphs. Finally, it combines the resulting base classifiers into an ensemble classifier. Experimental results on face recognition tasks demonstrate that SSC-RSDR not only has superior recognition performance with respect to competitive methods, but also is robust against a wide range of values of input parameters.