Text Alignment with Handwritten Documents

  • Authors:
  • E. Micah Kornfield;R. Manmatha;James Allan

  • Affiliations:
  • -;-;-

  • Venue:
  • DIAL '04 Proceedings of the First International Workshop on Document Image Analysis for Libraries (DIAL'04)
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Today's digital libraries increasingly include not only printed text but also scanned handwritten pages and other multimedia material. There are, however, few tools available for manipulating handwritten pages. Here, we propose an algorithm based on dynamic time warping (DTW) for a word by word alignment of handwritten documents with their (ASCII) transcripts. We see at least three uses for such alignment algorithms. First, alignment algorithms allow us to produce displays (for example on the web) that allow a person to easily find their place in the manuscript when reading a transcript. Second, such alignment algorithms will allow us to produce large quantities of ground truth data for evaluating handwriting recognition algorithms.Third, such algorithms allow us to produce indices in a straightforward manner for handwriting material. We provide experimental results of our algorithm on a set of 70 pages of historical handwritten material - specifically the writings of George Washington. Our method achieves74.5% accuracy on line by line alignment and 60.5% accuracy when aligning whole pages at time.