Highly accurate error-driven method for noun phrase detection

  • Authors:
  • Lourdes Araujo;J. Ignacio Serrano

  • Affiliations:
  • Dpto. Lenguajes y Sistemas Informáticos, ETSI Informática, Universidad Nacional de Educación a Distancia, C/ Juan del Rosal, 16, Madrid 28040, Spain;Instituto de Automática Industrial, CSIC. Ctra Campo Real, km. 0,200, La Poveda, 28500 Arganda del Rey, Madrid, Spain

  • Venue:
  • Pattern Recognition Letters
  • Year:
  • 2008

Quantified Score

Hi-index 0.10

Visualization

Abstract

We present a new model for detection of noun phrases in unrestricted text, whose most outstanding feature is its flexibility: the system is able to recognize noun phrases similar enough to the ones given by the inferred noun phrase grammar. The system provides a probabilistic finite-state automaton able to recognize the part-of-speech tag sequences which define a noun phrase. The recognition flexibility is possible by using a very accurate set of rankings for the FSA transitions. These accurate rankings are obtained by means of an evolutionary algorithm, which works with both, positive and negative examples of the language, thus improving the system coverage while maintaining its precision. We have tested the system on different corpora and evaluated different aspects of the system performance. We have also investigated other ways of improving the performance such as the application of certain filters in the training sets. The comparison of our results with other systems has revealed a considerable performance improvement.