A multi-stage chinese collocation extraction system

  • Authors:
  • Ruifeng Xu;Qin Lu

  • Affiliations:
  • Dept. of Computing, The Hong Kong Polytechnic University, Kowloon, Hong Kong;Dept. of Computing, The Hong Kong Polytechnic University, Kowloon, Hong Kong

  • Venue:
  • ICMLC'05 Proceedings of the 4th international conference on Advances in Machine Learning and Cybernetics
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Most of the existing collocation extraction systems are based on globally significant statistical behaviors without mechanisms to handle different types of collocations. By taking compositionality, substitutability, modifiability and internal associations into consideration, collocations are categorized into four different types in this work. Based on the analysis for each type of collocation, a multi-stage extraction system is designed using different combinations of discriminative features so as to identify different types of collocations in different stages. Perceptron training is employed to optimize the consolidation of discriminative features from different sources. Experiment results show that the achieved performance is much better than most reported work.