Feature selection using Bayesian and multiclass Support Vector Machines approaches: Application to bank risk prediction

  • Authors:
  • Asma Feki;Anis Ben Ishak;Saber Feki

  • Affiliations:
  • College of Economics and Management of Sfax, South University of Sfax, Route de l'Aéroport km 4, B.P. 1088-3018 Sfax, Tunisia;BESTMOD Laboratory, Higher Institute of Management of Tunis, University of Tunis, 41 rue de la liberté, cité Bouchoucha, 2000 Bardo, Tunisia;Department of Computer Science, University of Houston, 4800 Calhoun Rd, Houston Texas, TX 77004, USA

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2012

Quantified Score

Hi-index 12.05

Visualization

Abstract

This paper presents methods of banks discrimination according to the rate of NonPerforming Loans (NPLs), using Gaussian Bayes models and different approaches of multiclass Support Vector Machines (SVM). This classification problem involves many irrelevant variables and comparatively few training instances. New variable selection strategies are proposed. They are based on Gaussian marginal densities for Bayesian models and ranking scores derived from multiclass SVM. The results on both toy data and real-life problem of banks classification demonstrate a significant improvement of prediction performance using only a few variables. Moreover, Support Vector Machines approaches are shown to be superior to Gaussian Bayes models.