Scaling the kernel function based on the separating boundary in input space: A data-dependent way for improving the performance of kernel methods

Authors:
Jiancheng Sun;Xiaohe Li;Yong Yang;Jianguo Luo;Yaohui Bai
Affiliations:
School of Software and Communication Engineering, Jiangxi University of Finance and Economics, Nanchang 330013, China;School of Computer Science, Xi'an Shiyou University, Xi'an 710065, China;School of Information Technology, Jiangxi University of Finance and Economics, Nanchang 330013, China;School of Software and Communication Engineering, Jiangxi University of Finance and Economics, Nanchang 330013, China;School of Software and Communication Engineering, Jiangxi University of Finance and Economics, Nanchang 330013, China
Venue:
Information Sciences: an International Journal
Year:
2012

Citing 22
Cited 2

The nature of statistical learning theory

The nature of statistical learning theory
Geometry and invariance in kernel based methods

Advances in kernel methods
Improving support vector machine classifiers by modifying kernal functions

Neural Networks
Introduction to Algorithms

Introduction to Algorithms
A Tutorial on Support Vector Machines for Pattern Recognition

Data Mining and Knowledge Discovery
Choosing Multiple Parameters for Support Vector Machines

Machine Learning
Conformal Transformation of Kernel Functions: A Data-Dependent Way to Improve Support Vector Machine Classifiers

Neural Processing Letters
Bayesian inference for transductive learning of kernel matrix using the Tanner-Wong data augmentation algorithm

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Multiple kernel learning, conic duality, and the SMO algorithm

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Learning the kernel matrix by maximizing a KFD-based class separability criterion

Pattern Recognition
Neighborhood Property--Based Pattern Selection for Support Vector Machines

Neural Computation
Structured large margin machines: sensitive to data distributions

Machine Learning
Induction of multiple fuzzy decision trees based on rough set technique

Information Sciences: an International Journal
Choosing the kernel parameters for support vector machines by the inter-cluster distance in the feature space

Pattern Recognition
Improving generalization of fuzzy IF-THEN rules by maximizing fuzzy entropy

IEEE Transactions on Fuzzy Systems
Simultaneous feature selection and classification using kernel-penalized support vector machines

Information Sciences: an International Journal
A criterion for optimizing kernel parameters in KBDA for image retrieval

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Hybrid approach of selecting hyperparameters of support vector machine for regression

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Efficient tuning of SVM hyperparameters using radius/margin bound and iterative algorithms

IEEE Transactions on Neural Networks
Optimizing the kernel in the empirical feature space

IEEE Transactions on Neural Networks
A Geometrical Method to Improve Performance of the Support Vector Machine

IEEE Transactions on Neural Networks
Weighted Mahalanobis Distance Kernels for Support Vector Machines

IEEE Transactions on Neural Networks

Modeling and monitoring for handling nonlinear dynamic processes

Information Sciences: an International Journal
Fault detection and diagnosis of non-linear non-Gaussian dynamic processes using kernel dynamic independent component analysis

Information Sciences: an International Journal

Quantified Score

Hi-index	0.07

Visualization

Abstract

The performance of a kernel method often depends mainly on the appropriate choice of a kernel function. In this study, we present a data-dependent method for scaling the kernel function so as to optimize the classification performance of kernel methods. Instead of finding the support vectors in feature space, we first find the region around the separating boundary in input space, and subsequently scale the kernel function correspondingly. It is worth noting that the proposed method does not require a training step to enable a specified classification algorithm to find the boundary and can be applied to various classification methods. Experimental results using both artificial and real-world data are provided to demonstrate the robustness and validity of the proposed method.