Boosting-SVM: effective learning with reduced data dimension

  • Authors:
  • Ching-Wei Wang;Wun-Hong You

  • Affiliations:
  • Graduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan 106;Graduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan 106

  • Venue:
  • Applied Intelligence
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Learning problems over high dimensional data are common in real world applications. In this study, a聽challenging, large and lifelike database, the German traffic sign benchmark data, containing 43 classes and 51840 images, is used to demonstrate the strength of our proposed boosted support vector machine with deep learning architecture. Recognition of traffic signs is difficult, and it involves multiple categories, contains subsets of classes that may appear very similar to each other, and tends to have large variations within class in visual appearances due to illumination changes, partial occlusions, rotations and weather conditions. By combining a low variance error boosting algorithm, a low bias error support vector machine and deep learning architecture, an efficient and effective boosting support vector machine method is presented. It has been shown to greatly reduce data dimension and build classification models with higher prediction accuracy while utilizing fewer features and training instances. In evaluation, the proposed method outperforms Adaboost.M1, cw-Boost, and support vector machine, and it achieves ultra fast processing time (0.0038 per prediction) and high accuracy (93.5聽%) on prediction of separate test data utilizes less than 35聽% of the training instances. Moreover, the method is applicable to a standard standalone PC without requiring super computers with enormous memory spaces.