An open-source finite state morphological transducer for modern standard Arabic

Authors:
Mohammed Attia;Pavel Pecina;Antonio Toral;Lamia Tounsi;Josef van Genabith
Affiliations:
Dublin City University, Dublin, Ireland;Dublin City University, Dublin, Ireland;Dublin City University, Dublin, Ireland;Dublin City University, Dublin, Ireland;Dublin City University, Dublin, Ireland
Venue:
FSMNLP '11 Proceedings of the 9th International Workshop on Finite State Methods and Natural Language Processing
Year:
2011

Citing 4
Cited 0

Neural Networks: A Comprehensive Foundation

Neural Networks: A Comprehensive Foundation
Computational nonlinear morphology: with emphasis on semitic languages

Computational nonlinear morphology: with emphasis on semitic languages
Arabic morphological tagging, diacritization, and lemmatization using lexeme models and feature ranking

HLT-Short '08 Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Short Papers
Foma: a finite-state compiler and library

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics: Demonstrations Session

Quantified Score

Hi-index	0.00

Visualization

Abstract

We develop an open-source large-scale finitestate morphological processing toolkit (AraComLex) for Modern Standard Arabic (MSA) distributed under the GPLv3 license. The morphological transducer is based on a lexical database specifically constructed for this purpose. In contrast to previous resources, the database is tuned to MSA, eliminating lexical entries no longer attested in contemporary use. The database is built using a corpus of 1,089,111,204 words, a pre-annotation tool, machine learning techniques, and knowledge-based pattern matching to automatically acquire lexical knowledge. Our morphological transducer is evaluated and compared to LDC's SAMA (Standard Arabic Morphological Analyser).