An unsupervised language independent method of name discrimination using second order co-occurrence features

  • Authors:
  • Ted Pedersen;Anagha Kulkarni;Roxana Angheluta;Zornitsa Kozareva;Thamar Solorio

  • Affiliations:
  • University of Minnesota, Duluth;University of Minnesota, Duluth;Katholieke Universiteit Leuven, Belgium;University of Alicante, Spain;University of Texas at El Paso

  • Venue:
  • CICLing'06 Proceedings of the 7th international conference on Computational Linguistics and Intelligent Text Processing
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Previous work by Pedersen, Purandare and Kulkarni (2005) has resulted in an unsupervised method of name discrimination that represents the context in which an ambiguous name occurs using second order co–occurrence features. These contexts are then clustered in order to identify which are associated with different underlying named entities. It also extracts descriptive and discriminating bigrams from each of the discovered clusters in order to serve as identifying labels. These methods have been shown to perform well with English text, although we believe them to be language independent since they rely on lexical features and use no syntactic features or external knowledge sources. In this paper we apply this methodology in exactly the same way to Bulgarian, English, Romanian, and Spanish corpora. We find that it attains discrimination accuracy that is consistently well above that of a majority classifier, thus providing support for the hypothesis that the method is language independent.