Multi-Kernel based feature selection for regression

  • Authors:
  • Chao-Zhe Lin;Xian-Kai Chen

  • Affiliations:
  • Shenzhen Power Supply Bureau Co., Ltd, China Southern Power Grid, Shenzhen, China;Center for Digital Media Computing, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China

  • Venue:
  • ICIC'12 Proceedings of the 8th international conference on Intelligent Computing Theories and Applications
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

A frequent problem in support vector regression is to select appropriate features or parameters. We present an efficient feature selection method for regression problem where optimal kernel weights and model parameters are learned alternatively. Our approach generalizes v support vector regression and can be formulized as quadratic constrained quadratic programming which can be efficiently solved by level method. Moreover, we introduce an elastic-net-type constrain on the kernel weights. It finds the best trade-off sparsity and accuracy. Our algorithm keeps the useful information and discards redundant information; meanwhile it has the similar properties of v parameter. The experimental evaluation of the proposed algorithm on synthetic dataset and stock marketing price forecasting task show that our method can select suitable features for building model and attain competitive performance.