Support Vector Machine incorporated with feature discrimination

  • Authors:
  • Yunyun Wang;Songcan Chen;Hui Xue

  • Affiliations:
  • Department of Computer Science and Engineering, Nanjing University of Aeronautics & Astronautics, 210016 Nanjing, China;Department of Computer Science and Engineering, Nanjing University of Aeronautics & Astronautics, 210016 Nanjing, China;School of Computer Science & Engineering, Southeast University, 210016 Nanjing, China

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2011

Quantified Score

Hi-index 12.05

Visualization

Abstract

Support Vector Machine (SVM) achieves state-of-the-art performance in many real applications. A guarantee of its performance superiority is from the maximization of between-class margin, or loosely speaking, full use of discriminative information from between-class samples. While in this paper, we focus on not only such discriminative information from samples but also discrimination of individual features and develop feature discrimination incorporated SVM (FDSVM). Instead of minimizing the l"2-norm of feature weight vector, or equivalently, imposing equal penalization on all weight components in SVM learning, FDSVM penalizes each weight by an amount decreasing with the corresponding feature discrimination measure, consequently features with better discrimination can be attached greater importance. Experiments on both toy and real UCI datasets demonstrate that FDSVM often achieves better performance with comparable efficiency.