A Model Selection Criterion for Classification: Application to HMM Topology Optimization

  • Authors:
  • Alain Biem

  • Affiliations:
  • -

  • Venue:
  • ICDAR '03 Proceedings of the Seventh International Conference on Document Analysis and Recognition - Volume 1
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a model selection criterion for classificationproblems. The criterion focuses on selecting modelsthat are discriminant instead of models based on the Occam'srazor principle of parsimony between accurate modelingand complexity. The criterion, dubbed DiscriminativeInformation Criterion (DIC), is applied to the optimizationof Hidden Markov Model topology aimed at the recognitionof cursively-handwritten digits. The results show that DIC-generatedmodels achieve 18% relative improvement in per-formancefrom a baseline system generated by the BayesianInformation Criterion (BIC).