Domain adaptation with latent semantic association for named entity recognition

  • Authors:
  • Honglei Guo;Huijia Zhu;Zhili Guo;Xiaoxun Zhang;Xian Wu;Zhong Su

  • Affiliations:
  • IBM China Research Laboratory, Beijing, P. R. China;IBM China Research Laboratory, Beijing, P. R. China;IBM China Research Laboratory, Beijing, P. R. China;IBM China Research Laboratory, Beijing, P. R. China;IBM China Research Laboratory, Beijing, P. R. China;IBM China Research Laboratory, Beijing, P. R. China

  • Venue:
  • NAACL '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

Domain adaptation is an important problem in named entity recognition (NER). NER classifiers usually lose accuracy in the domain transfer due to the different data distribution between the source and the target domains. The major reason for performance degrading is that each entity type often has lots of domain-specific term representations in the different domains. The existing approaches usually need an amount of labeled target domain data for tuning the original model. However, it is a labor-intensive and time-consuming task to build annotated training data set for every target domain. We present a domain adaptation method with latent semantic association (LaSA). This method effectively overcomes the data distribution difference without leveraging any labeled target domain data. LaSA model is constructed to capture latent semantic association among words from the unlabeled corpus. It groups words into a set of concepts according to the related context snippets. In the domain transfer, the original term spaces of both domains are projected to a concept space using LaSA model at first, then the original NER model is tuned based on the semantic association features. Experimental results on English and Chinese corpus show that LaSA-based domain adaptation significantly enhances the performance of NER.