Applying conditional random fields to chinese shallow parsing

  • Authors:
  • Yongmei Tan;Tianshun Yao;Qing Chen;Jingbo Zhu

  • Affiliations:
  • Natural Language Processing Lab, Northeastern University, Shenyang;Natural Language Processing Lab, Northeastern University, Shenyang;Natural Language Processing Lab, Northeastern University, Shenyang;Natural Language Processing Lab, Northeastern University, Shenyang

  • Venue:
  • CICLing'05 Proceedings of the 6th international conference on Computational Linguistics and Intelligent Text Processing
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Chinese shallow parsing is a difficult, important and widely-studied sequence modeling problem. CRFs are new discriminative sequential models which may incorporate many rich features. This paper shows how conditional random fields (CRFs) can be efficiently applied to Chinese shallow parsing. We employ using CRFs and HMMs on a same data set. Our results confirm that CRFs improve the performance upon HMMs. Our approach yields the F1 score of 90.38% in Chinese shallow parsing with the UPenn Chinese Treebank. CRFs have shown to perform well for Chinese shallow parsing due to their ability to capture arbitrary, overlapping features of the input in a Markov model.