Sparse kernel-based feature weighting

  • Authors:
  • Shuang-Hong Yang;Yu-Jiu Yang;Bao-Gang Hu

  • Affiliations:
  • National Lab of Pattern Recognition & Sino-French IT Lab, LIAMA, Institute of Automation, Chinese Academy of Sciences and Graduate School, Chinese Academy of Sciences, Beijing, China;National Lab of Pattern Recognition & Sino-French IT Lab, LIAMA, Institute of Automation, Chinese Academy of Sciences and Graduate School, Chinese Academy of Sciences, Beijing, China;National Lab of Pattern Recognition & Sino-French IT Lab, LIAMA, Institute of Automation, Chinese Academy of Sciences and Graduate School, Chinese Academy of Sciences, Beijing, China

  • Venue:
  • PAKDD'08 Proceedings of the 12th Pacific-Asia conference on Advances in knowledge discovery and data mining
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

The success of many learning algorithms hinges on the reliable selection or construction of a set of highly predictive features. Kernel-based feature weighting bridges the gap between feature extraction and subset selection. This paper presents a rigorous derivation of the Kernel-Relief algorithm and assesses its effectiveness in comparison with other state-of-art techniques. For practical considerations, an online sparsification procedure is incorporated into the basis construction process by assuming that the kernel bases form a causal series. The proposed sparse Kernel-Relief algorithm not only produces nonlinear features with extremely sparse kernel expressions but also reduces the computational complexity significantly.