Recursive robust least squares support vector regression based on maximum correntropy criterion

  • Authors:
  • Xiaobo Chen;Jian Yang;Jun Liang;Qiaolin Ye

  • Affiliations:
  • School of Computer Science and Telecommunication Engineering, Jiangsu University, Zhenjiang 212013, PR China and School of Computer Science and Technology, Nanjing University of Science and Techno ...;School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing 210094, PR China;Automotive Engineering Research Institute, Jiangsu University, Zhenjiang 212013, PR China;School of Computer Science and Technology, Nanjing University of Science and Technology, Nanjing 210094, PR China

  • Venue:
  • Neurocomputing
  • Year:
  • 2012

Quantified Score

Hi-index 0.01

Visualization

Abstract

Least squares support vector machine for regression (LSSVR) is an efficient method for function estimation problem. However, its solution is prone to large noise and outliers since it depends on the minimum of the sum of squares error (SSE) on training samples. To tackle this problem, in this paper, a novel regression model termed as recursive robust LSSVR (R^2LSSVR) is proposed to obtain robust estimation for data in the presence of outliers. The idea is to build a regression model in the kernel space based on maximum correntropy criterion and regularization technique. An iterative algorithm derived from half-quadratic optimization is further developed to solve R^2LSSVR with theoretically guaranteed convergence. It also reveals that R^2LSSVR is closely related to the original LSSVR since it essentially solves adaptive weighted LSSVR iteratively. Furthermore, a hyperparameters selection method for R^2LSSVR is presented based on particle swarm optimization (PSO) such that multiple hyperparameters in R^2LSSVR can be estimated effectively for better performance. The feasibility of this method is examined on some simulated and benchmark datasets. The experimental results demonstrate the good robust performance of the proposed method.