Variable selection in kernel Fisher discriminant analysis by means of recursive feature elimination

  • Authors:
  • N. Louw;S. J. Steel

  • Affiliations:
  • Department of Statistics and Actuarial Science, University of Stellenbosch, Private Bag X1, 7602 Matieland, South Africa;Department of Statistics and Actuarial Science, University of Stellenbosch, Private Bag X1, 7602 Matieland, South Africa

  • Venue:
  • Computational Statistics & Data Analysis
  • Year:
  • 2006

Quantified Score

Hi-index 0.03

Visualization

Abstract

Variable selection serves a dual purpose in statistical classification problems: it enables one to identify the input variables which separate the groups well, and a classification rule based on these variables frequently has a lower error rate than the rule based on all the input variables. Kernel Fisher discriminant analysis (KFDA) is a recently proposed powerful classification procedure, frequently applied in cases characterised by large numbers of input variables. The important problem of eliminating redundant input variables before implementing KFDA is addressed in this paper. A backward elimination approach is recommended, and two criteria which can be used for recursive elimination of input variables are proposed and investigated. Their performance is evaluated on several data sets and in a simulation study.