Arabic morphological tagging, diacritization, and lemmatization using lexeme models and feature ranking

Authors:
Ryan Roth;Owen Rambow;Nizar Habash;Mona Diab;Cynthia Rudin
Affiliations:
Columbia University, New York, NY;Columbia University, New York, NY;Columbia University, New York, NY;Columbia University, New York, NY;Columbia University, New York, NY
Venue:
HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
Year:
2008

Citing 4
Cited 19

Morphological tagging: data vs. dictionaries

NAACL 2000 Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference
Arabic tokenization, part-of-speech tagging and morphological disambiguation in one fell swoop

ACL '05 Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics
Maximum entropy based restoration of Arabic diacritics

ACL-44 Proceedings of the 21st International Conference on Computational Linguistics and the 44th annual meeting of the Association for Computational Linguistics
Arabic diacritization through full morphological tagging

NAACL-Short '07 Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics; Companion Volume, Short Papers

Symbolic-to-statistical hybridization: extending generation-heavy machine translation

Machine Translation
Simultaneous tokenization and part-of-speech tagging for Arabic without a morphological analyzer

ACLShort '10 Proceedings of the ACL 2010 Conference Short Papers
A new approach to lexical disambiguation of Arabic text

EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Introduction to the Special Issue on Arabic Computational Linguistics

ACM Transactions on Asian Language Information Processing (TALIP)
Exploiting Separation of Closed-Class Categories for Arabic Tokenization and Part-of-Speech Tagging

ACM Transactions on Asian Language Information Processing (TALIP)
Using deep morphology to improve automatic error detection in Arabic handwriting recognition

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Improving Arabic dependency parsing with form-based and functional morphological features

HLT '11 Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies - Volume 1
Introduction to arabic natural language processing N. Y. Habash. Morgan & Claypool (synthesis lectures on human language technologies, vol. 10), 2010, xvii+167pp; isbn 978-1-59829-795-9, ebook isbn 978-1-59829-796-6

Computational Linguistics
Fuzzy syntactic reordering for phrase-based statistical machine translation

WMT '11 Proceedings of the Sixth Workshop on Statistical Machine Translation
Dialectal to standard Arabic paraphrasing to improve Arabic-English statistical machine translation

DIALECTS '11 Proceedings of the First Workshop on Algorithms and Resources for Modelling of Dialects and Language Varieties
Improved Arabic-to-English statistical machine translation by reordering post-verbal subjects for word alignment

Machine Translation
Orthographic and morphological processing for English---Arabic statistical machine translation

Machine Translation
Machine translation between Hebrew and Arabic

Machine Translation
An open-source finite state morphological transducer for modern standard Arabic

FSMNLP '11 Proceedings of the 9th International Workshop on Finite State Methods and Natural Language Processing
Arabic morphological analysis and disambiguation using a possibilistic classifier

ICIC'12 Proceedings of the 8th international conference on Intelligent Computing Theories and Applications
Recall-oriented learning of named entities in Arabic Wikipedia

EACL '12 Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics
Part of speech tagging for arabic

Natural Language Engineering
A hybrid approach to Arabic named entity recognition

Journal of Information Science
Maximum-entropy word alignment and posterior-based phrase extraction for machine translation

Machine Translation

Quantified Score

Hi-index	0.00

Visualization

Abstract

We investigate the tasks of general morphological tagging, diacritization, and lemmatization for Arabic. We show that for all tasks we consider, both modeling the lexeme explicitly, and retuning the weights of individual classifiers for the specific task, improve the performance.