Should MT systems be used as black boxes in CLIR?

  • Authors:
  • Walid Magdy;Gareth J. F. Jones

  • Affiliations:
  • Centre for Next Generation Localisation, School of Computing, Dublin City University, Dublin, Ireland;Centre for Next Generation Localisation, School of Computing, Dublin City University, Dublin, Ireland

  • Venue:
  • ECIR'11 Proceedings of the 33rd European conference on Advances in information retrieval
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The translation stage in cross language information retrieval (CLIR) acts as the main enabling stage to cross the language barrier between documents and queries. In recent years machine translation (MT) systems have become the dominant approach to translation in CLIR. However, unlike information retrieval (IR), MT focuses on the morphological and syntactical quality of the sentence. This requires large training resources and high computational power for training and translation. We present a novel technique for MT designed specifically for CLIR. In this method IR text pre-processing in the form of stop word removal and stemming are applied to the MT training corpus prior to the training phase. Applying this pre-processing step is found to significantly speed up the translation process without affecting the retrieval quality.