Candidate working set strategy based SMO algorithm in support vector machine

  • Authors:
  • Xiao-feng Song;Wei-min Chen;Yi-Ping Phoebe Chen;Bin Jiang

  • Affiliations:
  • College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, PR China;College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, PR China;School of Information Technology, Deakin University, Australia;College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, PR China

  • Venue:
  • Information Processing and Management: an International Journal
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Sequential minimal optimization (SMO) is quite an efficient algorithm for training the support vector machine. The most important step of this algorithm is the selection of the working set, which greatly affects the training speed. The feasible direction strategy for the working set selection can decrease the objective function, however, may augment to the total calculation for selecting the working set in each of the iteration. In this paper, a new candidate working set (CWS) Strategy is presented considering the cost on the working set selection and cache performance. This new strategy can select several greatest violating samples from Cache as the iterative working sets for the next several optimizing steps, which can improve the efficiency of the kernel cache usage and reduce the computational cost related to the working set selection. The results of the theory analysis and experiments demonstrate that the proposed method can reduce the training time, especially on the large-scale datasets.