Probabilistic Automaton Model for Fuzzy English-Text Retrieval

  • Authors:
  • Manabu Ohta;Atsuhiro Takasu;Jun Adachi

  • Affiliations:
  • -;-;-

  • Venue:
  • ECDL '00 Proceedings of the 4th European Conference on Research and Advanced Technology for Digital Libraries
  • Year:
  • 2000

Quantified Score

Hi-index 0.00

Visualization

Abstract

Optical character reader (OCR) misrecognition is a serious problem when searching against OCR-scanned documents in databases such as digital libraries. This paper proposes fuzzy retrieval methods for English text that contains errors in the recognized text without correcting the errors manually. Costs are thereby reduced. The proposed methods generate multiple search terms for each input query term based on probabilistic automata reflecting both error-occurrence probabilities and character-connection probabilities. Experimental results of test-set retrieval indicate that one of the proposed methods improves the recall rate from 95.56% to 97.88% at the cost of a decrease in precision rate from 100.00% to 95.52% with 20 expanded search terms.