Balancing error and supervision effort in interactive-predictive handwriting recognition

  • Authors:
  • Nicolás Serrano;Albert Sanchis;Alfons Juan

  • Affiliations:
  • Universitat Politècnica de València, València, Spain;Universitat Politècnica de València, València, Spain;Universitat Politècnica de València, València, Spain

  • Venue:
  • Proceedings of the 15th international conference on Intelligent user interfaces
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

An effective approach to transcribe handwritten text documents is to follow an interactive-predictive paradigm in which both, the system is guided by the user, and the user is assisted by the system to complete the transcription task as efficiently as possible. This approach has been recently implemented in a system prototype called GIDOC, in which standard speech technology is adapted to handwritten text (line) images: HMM-based text image modeling, n-gram language modeling, and also confidence measures on recognized words. Confidence measures are used to assist the user in locating possible transcription errors, and thus validate system output after only supervising those (few) words for which the system is not highly confident. However, a certain degree of supervision is required for proper model adaptation from partially supervised transcriptions. Here, we propose a simple yet effective method to find an optimal balance between recognition error and supervision effort.