An incremental support vector machine-trained TS-type fuzzy system for online classification problems

  • Authors:
  • Wei-Yuan Cheng;Chia-Feng Juang

  • Affiliations:
  • Department of Electrical Engineering, National Chung-Hsing University, Taichung 402, Taiwan, ROC;Department of Electrical Engineering, National Chung-Hsing University, Taichung 402, Taiwan, ROC

  • Venue:
  • Fuzzy Sets and Systems
  • Year:
  • 2011

Quantified Score

Hi-index 0.21

Visualization

Abstract

This paper proposes an incremental support vector machine-trained TS-type fuzzy classifier (ISVM-FC). The ISVM-FC is a fuzzy system that consists of Takagi-Sugeno (TS)-type fuzzy rules. Structure and parameters in the ISVM-FC are trained incrementally from one subset of training data at a time. This incremental training approach avoids the use of large amounts of memory required for storing training data in batch learning, reduces training time, and adapts the classifier to time-dependent classification systems where training data are available sequentially. Initially, there are no fuzzy rules for structure learning with the ISVM-FC. It generates all rules according to the distribution of the training data. An incremental linear support vector machine (SVM) is used to tune the resulting rule parameters to give the classifier better generalization performance. The use of incremental learning discards past training data adaptively according to its distance to the linear hyperplane, thereby improving learning efficiency. Three simulations are conducted to verify the performance of the ISVM-FC. Comparisons with fuzzy classifiers and Gaussian-kernel SVM with batch and incremental learning modes demonstrate that the ISVM-FC improves training and test times, and reduces memory consumption for classifier storage without deteriorating the generalization ability.