Automatic extraction of low frequency bilingual word pairs from parallel corpora with various languages

Authors:
Hiroshi Echizen-ya;Kenji Araki;Yoshio Momouchi
Affiliations:
Dept. of Electronics and Information, Hokkai-Gakuen University, Sapporo, Japan;Graduate School of Information Science and Technology, Hokkaido University, Sapporo, Japan;Dept. of Electronics and Information, Hokkai-Gakuen University, Sapporo, Japan
Venue:
PAKDD'05 Proceedings of the 9th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining
Year:
2005

Citing 5
Cited 1

Translating collocations for bilingual lexicons: a statistical approach

Computational Linguistics
Foundations of statistical natural language processing

Foundations of statistical natural language processing
Extraction of lexical translations from non-aligned corpora

COLING '96 Proceedings of the 16th conference on Computational linguistics - Volume 2
Study of practical effectiveness for machine translation using recursive chain-link-type learning

COLING '02 Proceedings of the 19th international conference on Computational linguistics - Volume 1
Integrating cross-lingually relevant news articles and monolingual web documents in bilingual lexicon acquisition

COLING '04 Proceedings of the 20th international conference on Computational Linguistics

Automatic extraction of bilingual word pairs using inductive chain learning in various languages

Information Processing and Management: an International Journal

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a new learning method for extraction of low-frequency bilingual word pairs from parallel corpora with various languages. It is important to extract low-frequency bilingual word pairs because the frequencies of many bilingual word pairs are very low when large-scale parallel corpora are unobtainable. We use the following inference to extract low frequency bilingual word pairs: the word equivalents that adjoin the source language words of bilingual word pairs also adjoin the target language words of bilingual word pairs in local parts of bilingual sentence pairs. Evaluation experiments indicated that the extraction rate of our system was more than 8.0 percentage points higher than the extraction rate of the system based on the Dice coefficient. Moreover, the extraction rates of bilingual word pairs for which the frequencies are one and two respectively improved 11.0 and 6.6 percentage points using AIL.