A trainable feature extractor for handwritten digit recognition

  • Authors:
  • Fabien Lauer;Ching Y. Suen;Gérard Bloch

  • Affiliations:
  • Centre de Recherche en Automatique de Nancy (CRAN UMR 7039), Nancy-Univerity, CNRS CRAN-ESSTIN, Rue Jean Lamour, 54519 Vanduvre Cedex, France;Center for Pattern Recognition and Machine Intelligence (CENPARMI), Concordia University, 1455 de Maisonneuve Blvd West, Suite EV003.403, Montréal, QC, Canada, H3G 1M8;Centre de Recherche en Automatique de Nancy (CRAN UMR 7039), Nancy-Univerity, CNRS CRAN-ESSTIN, Rue Jean Lamour, 54519 Vanduvre Cedex, France

  • Venue:
  • Pattern Recognition
  • Year:
  • 2007

Quantified Score

Hi-index 0.01

Visualization

Abstract

This article focuses on the problems of feature extraction and the recognition of handwritten digits. A trainable feature extractor based on the LeNet5 convolutional neural network architecture is introduced to solve the first problem in a black box scheme without prior knowledge on the data. The classification task is performed by support vector machines to enhance the generalization ability of LeNet5. In order to increase the recognition rate, new training samples are generated by affine transformations and elastic distortions. Experiments are performed on the well-known MNIST database to validate the method and the results show that the system can outperform both SVMs and LeNet5 while providing performances comparable to the best performance on this database. Moreover, an analysis of the errors is conducted to discuss possible means of enhancement and their limitations.