Adaptive chaotic cultural algorithm for hyperparameters selection of support vector regression

  • Authors:
  • Jian Cheng;Jiansheng Qian;Yi-Nan Guo

  • Affiliations:
  • School of Information and Electrical Engineering, China University of Mining and Technology, Xu Zhou, China and Department of Automation, Tsinghua University, Beijing, China;School of Information and Electrical Engineering, China University of Mining and Technology, Xu Zhou, China;School of Information and Electrical Engineering, China University of Mining and Technology, Xu Zhou, China

  • Venue:
  • ICIC'09 Proceedings of the Intelligent computing 5th international conference on Emerging intelligent computing technology and applications
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

The hyperparameters selection has a great affection on accuracy of support vector regression (SVR). In order to determine the hyperparameters of SVR, an adaptive chaotic cultural algorithm (ACCA) is employed for the optimal hyperparameters including kernel parameterss of Gaussian kernel function, regular constant γ and Ɛ in the Ɛ -insensitive loss function. Based on this, a learning algorithm with two-stage is constructed to realize the objective. Firstly, the initialization search spaces of hyperparameters are determined according to their influence on the performance of support vector regression. Secondly, optimal hyperparameters are selected using ACCA. ACCA adopt dual structure in cultural algorithm and adaptive chaotic mutation in evolution induction functions, and uses implicit knowledge extracted from evolution process to control mutation scale, which inducts individuals escaping from local best solutions. Taken the forecasting of gas concentration as example, experiment results indicate optimal hyperparameters can be obtained through above strategy.