Learning word-level dialectal variation as phonological replacement rules using a limited parallel corpus

Authors:
Mans Hulden;Iñaki Alegria;Izaskun Etxeberria;Montse Maritxalar
Affiliations:
University of Helsinki;IXA taldea, UPV-EHU;IXA taldea, UPV-EHU;IXA taldea, UPV-EHU
Venue:
DIALECTS '11 Proceedings of the First Workshop on Algorithms and Resources for Modelling of Dialects and Language Varieties
Year:
2011

Citing 7
Cited 0

Using Finite State Technology in Natural Language Processing of Basque

CIAA '01 Revised Papers from the 6th International Conference on Implementation and Application of Automata
A discovery procedure for certain phonological rules

ACL '84 Proceedings of the 10th International Conference on Computational Linguistics and 22nd annual meeting on Association for Computational Linguistics
Multipath translation lexicon induction via bridge languages

NAACL '01 Proceedings of the second meeting of the North American Chapter of the Association for Computational Linguistics on Language technologies
Adaptive string distance measures for bilingual dialect lexicon induction

ACL '07 Proceedings of the 45th Annual Meeting of the ACL: Student Research Workshop
Regular Expressions and Predicate Logic in Finite-State Language Processing

Proceedings of the 2009 conference on Finite-State Methods and Natural Language Processing: Post-proceedings of the 7th International Workshop FSMNLP 2008
Foma: a finite-state compiler and library

EACL '09 Proceedings of the 12th Conference of the European Chapter of the Association for Computational Linguistics: Demonstrations Session
Valuable language resources and applications supporting the use of Basque

LTC'09 Proceedings of the 4th conference on Human language technology: challenges for computer science and linguistics

Quantified Score

Hi-index	0.02

Visualization

Abstract

This paper explores two different methods of learning dialectal morphology from a small parallel corpus of standard and dialect-form text, given that a computational description of the standard morphology is available. The goal is to produce a model that translates individual lexical dialectal items to their standard dialect counterparts in order to facilitate dialectal use of available NLP tools that only assume standard-form input. The results show that a learning method based on inductive logic programming quickly converges to the correct model with respect to many phonological and morphological differences that are regular in nature.