Retrieval effectiveness of machine translated queries

  • Authors:
  • Ljiljana Dolamic;Jacques Savoy

  • Affiliations:
  • Computer Science Department, University of Neuchatel, Rue Emile Argand 11, 2009 Neuchâtel, Switzerland;Computer Science Department, University of Neuchatel, Rue Emile Argand 11, 2009 Neuchâtel, Switzerland

  • Venue:
  • Journal of the American Society for Information Science and Technology
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This article describes and evaluates various information retrieval models used to search document collections written in English through submitting queries written in various other languages, either members of the Indo-European family (English, French, German, and Spanish) or radically different language groups such as Chinese. This evaluation method involves searching a rather large number of topics (around 300) and using two commercial machine translation systems to translate across the language barriers. In this study, mean average precision is used to measure variances in retrieval effectiveness when a query language differs from the document language. Although performance differences are rather large for certain languages pairs, this does not mean that bilingual search methods are not commercially viable. Causes of the difficulties incurred when searching or during translation are analyzed and the results of concrete examples are explained. © 2010 Wiley Periodicals, Inc.