A stochastic Japanese morphological analyzer using a forward-DP backward-A* N-best search algorithm

Authors:
Masaaki Nagata
Affiliations:
NTT Network Information Systems Laboratories, Kanagawa, Japan
Venue:
COLING '94 Proceedings of the 15th conference on Computational linguistics - Volume 1
Year:
1994

Citing 3
Cited 26

Self-organized language modeling for speech recognition

Readings in speech recognition
Procedure for quantitatively comparing the syntactic coverage of English grammars

HLT '91 Proceedings of the workshop on Speech and Natural Language
A practical part-of-speech tagger

ANLC '92 Proceedings of the third conference on Applied natural language processing

A stochastic finite-state word-segmentation algorithm for Chinese

Computational Linguistics
Syllable-pattern-based unknown-morpheme segmentation and estimation for hybrid part-of-speech tagging of Korean

Computational Linguistics
A Hierarchical Phrase Alignment from English and Japanese Bilingual Text

CICLing '01 Proceedings of the Second International Conference on Computational Linguistics and Intelligent Text Processing
Mostly-unsupervised statistical segmentation of Japanese Kanji sequences

Natural Language Engineering
Mostly-unsupervised statistical segmentation of Japanese: applications to kanji

NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
Mistake-driven mixture of hierarchical tag context trees

ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics
Japanese morphological analyzer using word co-occurrence: JTAG

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Use of mutual information based character clusters in dictionary-less morphological analysis of Japanese

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Robust segmentation of Japanese text into a lattice for parsing

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
N-th order Ergodic Multigram HMM for modeling of languages without marked word boundaries

COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 1
Using a broad-coverage parser for word-breaking in Japanese

COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 2
Context-based spelling correction for Japanese OCR

COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 2
A gradual refinement model for a robust thai morphological analyzer

COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 2
A Chinese word segmentation based on language situation in processing ambiguous words

Information Sciences: an International Journal
A part of speech estimation method for Japanese unknown words using a statistical model of morphology and context

ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
An efficient statistical speech act type tagging system for speech translation systems

ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
Bringing the dictionary to the user: the FOKS system

COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
A statistical model for domain-independent text segmentation

ACL '01 Proceedings of the 39th Annual Meeting on Association for Computational Linguistics
Synchronous morphological analysis of grapheme and phoneme for Japanese OCR

ACL '00 Proceedings of the 38th Annual Meeting on Association for Computational Linguistics
Finding translation pairs from English-Japanese untokenized aligned corpora

S2S '02 Proceedings of the ACL-02 workshop on Speech-to-speech translation: algorithms and systems - Volume 7
Multi-language named-entity recognition system based on HMM

MultiNER '03 Proceedings of the ACL 2003 workshop on Multilingual and mixed-language named entity recognition - Volume 15
Phoneme-to-text transcription system with an infinite vocabulary

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
An error-driven word-character hybrid model for joint Chinese word segmentation and POS tagging

ACL '09 Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 1 - Volume 1
Unsupervised Text Normalization Approach for Morphological Analysis of Blog Documents

AI '09 Proceedings of the 22nd Australasian Joint Conference on Advances in Artificial Intelligence
A comparison of model free versus model intensive approaches to sentence compression

EMNLP '09 Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1 - Volume 1
Pointwise prediction for robust, adaptable Japanese morphological analysis

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers - Volume 2

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a novel method for segmenting the input sentence into words and assigning parts of speech to the words. It consists of a statistical language model and an efficient two-pass N-best search algorithm. The algorithm does not require delimiters between words. Thus it is suitable for written Japanese. The proposed Japanese morphological analyzer achieved 95.1% recall and 94.6% precision for open text when it was trained and tested on the ATR Corpus.