Recognizing natural scene characters by convolutional neural network and bimodal image enhancement

  • Authors:
  • Yuanping Zhu;Jun Sun;Satoshi Naoi

  • Affiliations:
  • Department of Computer Science, Tianjin Normal University, Tianjin, China;Fujitsu R&D Center Co. Ltd., Beijing, China;Fujitsu R&D Center Co. Ltd., Beijing, China

  • Venue:
  • CBDAR'11 Proceedings of the 4th international conference on Camera-Based Document Analysis and Recognition
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, a natural scene character recognition method using convolutional neural network(CNN) and bimodal image enhancement is proposed. CNN based grayscale character recognizer has strong tolerance to degradations in natural scene images. Since character image is bimodal pattern image in essence, bimodal image enhancement is adopted to improve the performance of CNN classifier. Firstly, a maximum separability based color-to-gray method is used to strengthen the discriminative power in grayscale image space. Secondly, grayscale distribution normalization based on histogram alignment is performed. Through increasing the data consistency among grayscale training and test samples, it leads to a better CNN classifier. Thirdly, a shape holding grayscale character image normalization is adopted. Based on these measures, a high performance natural scene character recognizer is constructed. The recognition rate of 85.96% on ICDAR 2003 robust OCR dataset is higher than existing works, which verified the effectiveness of the proposed method.