Pointwise prediction for robust, adaptable Japanese morphological analysis

  • Authors:
  • Graham Neubig;Yosuke Nakata;Shinsuke Mori

  • Affiliations:
  • Kyoto University, Yoshida Honmachi, Sakyo-ku, Kyoto, Japan;Kyoto University, Yoshida Honmachi, Sakyo-ku, Kyoto, Japan;Kyoto University, Yoshida Honmachi, Sakyo-ku, Kyoto, Japan

  • Venue:
  • HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a pointwise approach to Japanese morphological analysis (MA) that ignores structure information during learning and tagging. Despite the lack of structure, it is able to outperform the current state-of-the-art structured approach for Japanese MA, and achieves accuracy similar to that of structured predictors using the same feature set. We also find that the method is both robust to out-of-domain data, and can be easily adapted through the use of a combination of partial annotation and active learning.