Information Processing and Management: an International Journal - Special issue on data compression for images and texts
Information Retrieval: Computational and Theoretical Aspects
Information Retrieval: Computational and Theoretical Aspects
The mathematics of statistical machine translation: parameter estimation
Computational Linguistics - Special issue on using large corpora: II
Compression of Multilingual Aligned Texts
DCC '06 Proceedings of the Data Compression Conference
On the Use of Word Alignments to Enhance Bitext Compression
DCC '09 Proceedings of the 2009 Data Compression Conference
A Two-Level Structure for Compressing Aligned Bitexts
SPIRE '09 Proceedings of the 16th International Symposium on String Processing and Information Retrieval
| Hi-index | 0.00 |
Multilingual text compression exploits the existence of the same text in several languages to compress the second and subsequent copies by reference to the first. This is done based on bilingual text alignment, a mapping of words and phrases in one text to their semantic equivalents in the translation. A new multilingual text compression scheme is suggested, which improves over an immediate generalization of bilingual algorithms. The idea is to store the necessary markup data within the source language text; the incurred compression loss due to this overhead is smaller than the savings in the compressed target language texts, for a large enough number of the latter. Experimental results are presented for a parallel corpus in six languages extracted from the EURLex website of the European Union. These results show the superiority of the new algorithm as a function of the number languages.