Corpus-based cross-language information retrieval in retrieval of highly relevant documents: Research Articles

  • Authors:

  • Tuomas Talvensaari;Martti Juhola;Jorma Laurikkala;Kalervo Järvelin

  • Affiliations:

  • Department of Computer Sciences, University of Tampere, Kanslerinrinne 1, FIN-33014 University of Tampere, Finland.;Department of Computer Sciences, University of Tampere, Kanslerinrinne 1, FIN-33014 University of Tampere, Finland.;Department of Computer Sciences, University of Tampere, Kanslerinrinne 1, FIN-33014 University of Tampere, Finland.;Department of Information Studies, University of Tampere, Kanslerinrinne 1, FIN-33014 University of Tampere, Finland

  • Venue:
  • Journal of the American Society for Information Science and Technology
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Information retrieval systems' ability to retrieve highly relevant documents has become more and more important in the age of extremely large collections, such as the World Wide Web (WWW). The authors' aim was to find out how corpus-based cross-language information retrieval (CLIR) manages in retrieving highly relevant documents. They created a Finnish–Swedish comparable corpus from two loosely related document collections and used it as a source of knowledge for query translation. Finnish test queries were translated into Swedish and run against a Swedish test collection. Graded relevance assessments were used in evaluating the results and three relevance criterion levels—liberal, regular, and stringent—were applied. The runs were also evaluated with generalized recall and precision, which weight the retrieved documents according to their relevance level. The performance of the Comparable Corpus Translation system (COCOT) was compared to that of a dictionary-based query translation program; the two translation methods were also combined. The results indicate that corpus-based CLIR performs particularly well with highly relevant documents. In average precision, COCOT even matched the monolingual baseline on the highest relevance level. The performance of the different query translation methods was further analyzed by finding out reasons for poor rankings of highly relevant documents. © 2007 Wiley Periodicals, Inc.