Multext-East: parallel and comparable corpora and lexicons for six Central and Eastern European languages

  • Authors:
  • Ludmila Dimitrova;Nancy Ide;Vladimir Petkevic;Tomaz Erjavec;Heiki Jaan Kaalep;Dan Tufis

  • Affiliations:
  • Institute of Mathematics and Informatics, Sofia, Bulgaria;Vassar College, Poughkeepsie, New York;Charles University, Prague, Czech Republic;Institute Jozef Stefan, Ljubljana, Slovenia;University of Tartu, Tartu, Estonia;Romanian Academy, Center for Artificial Intelligence, Bucharest, Romania

  • Venue:
  • COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
  • Year:
  • 1998

Quantified Score

Hi-index 0.00

Visualization

Abstract

The EU Copernicus project Multext-East has created a multi-lingual corpus of text and speech data, covering the six languages of the project: Bulgarian, Czech, Estonian, Hungarian, Romanian, and Slovene. In addition, wordform lexicons for each of the languages were developed. The corpus includes a parallel component consisting of Orwell's Nineteen Eighty-Four, with versions in all six languages tagged for part-of-speech and aligned to English (also tagged for POS). We describe the encoding format and data architecture designed especially for this corpus, which is generally usable for encoding linguistic corpora. We also describe the methodology for the development of a harmonized set of morphosyntactic descriptions (MSDs), which builds upon the scheme for western European languages developed within the EAGLES project. We discuss the special concerns for handling the six project languages, which cover three distinct language families.