Hybrid HMM/ANN models for bimodal online and offline cursive word recognition

  • Authors:
  • S. España-Boquera;J. Gorbe-Moya;F. Zamora-Martínez;M. J. Castro-Bleda

  • Affiliations:
  • Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia, Valencia, Spain;Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia, Valencia, Spain;Departamento de Ciencias Físicas, Matemáticas y de la Computación, Universidad CEU-Cardenal Herrera, Valencia, Spain;Departamento de Sistemas Informáticos y Computación, Universidad Politécnica de Valencia, Valencia, Spain

  • Venue:
  • ICPR'10 Proceedings of the 20th International conference on Recognizing patterns in signals, speech, images, and videos
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

The recognition performance of current automatic offline handwriting transcription systems is far from being perfect. This is the reason why there is a growing interest in assisted transcription systems, which are more efficient than correcting by hand an automatic transcription. A recent approach to interactive transcription involves multimodal recognition, where the user can supply an online transcription of some of the words. In this paper, a description of the bimodal engine, which entered the "Bi-modal Handwritten Text Recognition" contest organized during the 2010 ICPR, is presented. The proposed recognition system uses Hidden Markov Models hybridized with neural networks (HMM/ANN) for both offline and online input. The N-best word hypothesis scores for both the offline and the online samples are combined using a log-linear combination, achieving very satisfying results.