Bayesian decision theory for support vector machines: Imbalance measurement and feature optimization

  • Authors:
  • Che-Chang Hsu;Kuo-Shong Wang;Shih-Hsing Chang

  • Affiliations:
  • Department of Mechanical Engineering, National Central University, No. 300, Jhongda Rd., Jhongli City, Taoyuan County, Taiwan;Department of Mechanical Engineering, National Central University, No. 300, Jhongda Rd., Jhongli City, Taoyuan County, Taiwan;Institute of Business and Management, Vanung University, No. 1, Van-Nung Rd., Chung-Li, Tao-Yuan 320614, Taiwan

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2011

Quantified Score

Hi-index 12.05

Visualization

Abstract

Classification approaches usually present the poor generalization performance with an apparent class imbalance problem. Surely, a measures of the quality of the possible models reflected the remaining uncertainty in the class imbalance on learning. The purpose of our learning method is to lead an attractive pragmatic expansion scheme of the Bayesian approach to assess how well it is aligned with the class imbalance problem. Thus, we propose a method with a model assessment of the interplay between various classification decisions using probability, corresponding decision costs, and quadratic program of optimal margin classifier called: Bayesian Support Vector Machines (BSVMs) learning strategy. In the framework, we did modify in the objects and conditions of primal problem to reproduce an appropriate learning rule for an observation sample. The experiments on several existing data sets showed that BSVMs may appropriately capture the true relationship between the inputs and outputs by experimental evidence.