Pattern Recognition Letters
Extracting parallel paragraphs and sentences from english-persian translated documents
AIRS'11 Proceedings of the 7th Asia conference on Information Retrieval Technology
| Hi-index | 0.00 |
Sentence alignment in bilingual corpora has been an active research topic in the Machine Translation research groups. There have been multiple works in the past to align sentences in bilingual corpus in English and Euro-pean languages and some Asian languages like Chinese and Japanese. This work introduces a novel approach for sentence alignment in bilingual corpora using lexical and statistical information about the language pair using genetic algorithm. The only lexical information used in this work is a restricted form of bilingual dictionary (incom-plete). The algorithm works based on the weighted sum of a set of statistical parameters and the parameter denoting degree of dictionary match. No other lexical information like part of speech tagging, chunking, n-gram statistics etc has been used in this work. Our approach has been tested for structurally dissimilar language pair of English-Hindi and is shown to yield a high performance even under noisy conditions. We compare our results with that of Microsoft alignment tool on the same corpus and we find our results to be superior.