The theoretical analysis of FDA and applications

  • Authors:
  • Qing Tao;Gao-wei Wu;Jue Wang

  • Affiliations:
  • The Key Laboratory of Complex Systems and Intelligence Science, Institute of Automation, Chinese Academy of Sciences, Beijing 100080, PR China;Bioinformatics Research Group, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100080, PR China;The Key Laboratory of Complex Systems and Intelligence Science, Institute of Automation, Chinese Academy of Sciences, Beijing 100080, PR China

  • Venue:
  • Pattern Recognition
  • Year:
  • 2006

Quantified Score

Hi-index 0.02

Visualization

Abstract

Representation and embedding are usually the two necessary phases in designing a classifier. Fisher discriminant analysis (FDA) is regarded as seeking a direction for which the projected samples are well separated. In this paper, we analyze FDA in terms of representation and embedding. The main contribution is that we prove that the general framework of FDA is based on the simplest and most intuitive FDA with zero within-class variance and therefore the mechanism of FDA is clearly illustrated. Based on our analysis, @e-insensitive SVM regression can be viewed as a soft FDA with @e-insensitive within-class variance and L"1 norm penalty. To verify this viewpoint, several real classification experiments are conducted to demonstrate that the performance of the regression-based classification technique is comparable to regular FDA and SVM.