Developing multilingual text mining workflows in UIMA and u-compare

  • Authors:
  • Georgios Kontonasios;Ioannis Korkontzelos;Sophia Ananiadou

  • Affiliations:
  • National Centre for Text Mining, School of Computer Science, The University of Manchester, UK;National Centre for Text Mining, School of Computer Science, The University of Manchester, UK;National Centre for Text Mining, School of Computer Science, The University of Manchester, UK

  • Venue:
  • NLDB'12 Proceedings of the 17th international conference on Applications of Natural Language Processing and Information Systems
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a generic, language-independent method for the construction of multilingual text mining workflows. The proposed mechanism is implemented as an extension of U-Compare, a platform built on top of the Unstructured Information Management Architecture (UIMA) that allows the construction, comparison and evaluation of interoperable text mining workflows. UIMA was previously supporting strictly monolingual workflows. Building multilingual workflows exhibits challenging problems, such as representing multilingual document collections and executing language-dependent components in parallel. As an application of our method, we develop a multilingual workflow that extracts terms from a parallel collection using a new heuristic. For our experiments, we construct a parallel corpus consisting of approximately 188.000 PubMed article titles for French and English. Our application is evaluated against a popular monolingual term extraction method, C Value.