Persian POS tagging using probabilistic morphological analysis

Authors:
Hakimeh Fadaei;Mehrnoush Shamsfard
Affiliations:
NLP Research Laboratory, Faculty of Electrical and Computer Engineering, Shahid Beheshti University, Evin, Tehran, 1983963113, Iran.;NLP Research Laboratory, Faculty of Electrical and Computer Engineering, Shahid Beheshti University, Evin, Tehran, 1983963113, Iran
Venue:
International Journal of Computer Applications in Technology
Year:
2010

Citing 4
Cited 0

An algorithm for suffix stripping

Readings in information retrieval
Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition

Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition
Bon: The Persian Stemmer

EurAsia-ICT '02 Proceedings of the First EurAsian Conference on Information and Communication Technology
A Stemming Algorithm for the Farsi Language

ITCC '05 Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'05) - Volume I - Volume 01

Quantified Score

Hi-index	0.00

Visualization

Abstract

Part of speech (POS) tagging as a fundamental task in natural language processing (NLP) has attracted many research efforts and many taggers are developed with different approaches to reach high performance and accuracy. In many complex applications of NLP, tagged corpora are among essential resources and designing an algorithm to create or enrich these resources is of high importance. Handling unknown words is a challenge in POS tagging which usually decreases the performance of taggers. This paper presents a POS tagger for Persian. It exploits a hybrid approach which is a combination of statistical and rule-based methods to tag Persian sentences. The proposed tagger uses a novel probabilistic morphological analysis to tag unknown words. As a secondary result of this research a knowledge base of Persian morphological rules with their probabilities is built according to a corpus. Experimental results show that our method improves the tagging performance and accuracy.