Non-uniform multiple kernel learning with cluster-based gating functions

  • Authors:
  • Yadong Mu;Bingfeng Zhou

  • Affiliations:
  • Department of Electrical and Computer Engineering, National University of Singapore, 117576 Singapore, Singapore and Institute of Computer Science and Technology, Peking University, Beijing 100871 ...;Institute of Computer Science and Technology, Peking University, Beijing 100871, PR China

  • Venue:
  • Neurocomputing
  • Year:
  • 2011

Quantified Score

Hi-index 0.01

Visualization

Abstract

Recently, multiple kernel learning (MKL) has gained increasing attention due to its empirical superiority over traditional single kernel based methods. However, most of state-of-the-art MKL methods are ''uniform'' in the sense that the relative weights of kernels keep fixed among all data. Here we propose a ''non-uniform'' MKL method with a data-dependent gating mechanism, i.e., adaptively determine the kernel weights for the samples. We utilize a soft clustering algorithm and then tune the weight for each cluster under the graph embedding (GE) framework. The idea of exploiting cluster structures is based on the observation that data from the same cluster tend to perform consistently, which thus increases the resistance to noises and results in more reliable estimate. Moreover, it is computationally simple to handle out-of-sample data, whose implicit RKHS representations are modulated by the posterior to each cluster. Quantitative studies between the proposed method and some representative MKL methods are conducted on both synthetic and widely used public data sets. The experimental results well validate its superiorities.