A study of regularized Gaussian classifier in high-dimension small sample set case based on MDL principle with application to spectrum recognition

  • Authors:
  • Ping Guo;Yunde Jia;Michael R. Lyu

  • Affiliations:
  • School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, PR China and Laboratory of Image Processing and Pattern Recognition, Beijing Normal University, Beijing, ...;School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, PR China;Department of Computer Science and Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong SAR, PR China

  • Venue:
  • Pattern Recognition
  • Year:
  • 2008

Quantified Score

Hi-index 0.01

Visualization

Abstract

In classifying high-dimensional patterns such as stellar spectra by a Gaussian classifier, the covariance matrix estimated with a small-number sample set becomes unstable, leading to degraded classification accuracy. In this paper, we investigate the covariance matrix estimation problem for small-number samples with high dimension setting based on minimum description length (MDL) principle. A new covariance matrix estimator is developed, and a formula for fast estimation of regularization parameters is derived. Experiments on spectrum pattern recognition are conducted to investigate the classification accuracy with the developed covariance matrix estimator. Higher classification accuracy results are obtained and demonstrated in our new approach.