Learning SVM with Varied Example Cost: A kNN Evaluating Approach

  • Authors:
  • Chan-Yun Yang;Che-Chang Hsu;Jr-Syu Yang

  • Affiliations:
  • Department of Mechanical Engineering, Technology and Science Institute of, Northern Taiwan, No. 2, Xue-Yuan Rd., Beitou, Taipei, Taiwan, 112., China;Department of Mechanical and Electro-Mechanical Engineering, Tamkang University Taipei, Taiwan, 251., China;Department of Mechanical and Electro-Mechanical Engineering, Tamkang University Taipei, Taiwan, 251., China

  • Venue:
  • Computational Intelligence and Security
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

The paper proposes a model merging a non-parametric k-nearest-neighbor (kNN) method into an underlying support vector machine (SVM) to produce an instance-dependent loss function. In this model, a filtering stage of the kNN searching was employed to collect information from training examples and produced a set of emphasized weights which can be distributed to every example by a class of real-valued class labels. The emphasized weights changed the policy of the equal-valued impacts of the training examples and permitted a more efficient way to utilize the information behind the training examples with various significance levels. Due to the property of estimating density locally, the kNN method has the advantage to distinguish the heterogeneous examples from the regular examples by merely considering the situation of the examples themselves. The paper shows the model is promising with both the theoretical derivations and consequent experimental results.