Improving the performance of dictionary-based approaches in protein name recognition

  • Authors:
  • Yoshimasa Tsuruoka;Jun'ichi Tsujii

  • Affiliations:
  • CREST, Japan Science and Technology (JST) Agency, Honcho 4-1-8, Kawaguchi-shi, Saitama 332-0012, Japan;Department of Computer Science, University of Tokyo, Hongo 7-3-1, Bunkyo-ku, Tokyo 113-0033, Japan

  • Venue:
  • Journal of Biomedical Informatics - Special issue: Named entity recognition in biomedicine
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Dictionary-based protein name recognition is often a first step in extracting information from biomedical documents because it can provide ID information on recognized terms. However, dictionary-based approaches present two fundamental difficulties: (1) false recognition mainly caused by short names; (2) low recall due to spelling variations. In this paper, we tackle the former problem using machine learning to filter out false positives and present two alternative methods for alleviating the latter problem of spelling variations. The first is achieved by using approximate string searching, and the second by expanding the dictionary with a probabilistic variant generator, which we propose in this paper. Experimental results using the GENIA corpus revealed that filtering using a naive Bayes classifier greatly improved precision with only a slight loss of recall, resulting in 10.8% improvement in F-measure, and dictionary expansion with the variant generator gave further 1.6% improvement and achieved an F-measure of 66.6%.