How feasible and robust is the automatic extraction of gene regulation events?: a cross-method evaluation under lab and real-life conditions

  • Authors:
  • Udo Hahn;Katrin Tomanek;Ekaterina Buyko;Jung-jae Kim;Dietrich Rebholz-Schuhmann

  • Affiliations:
  • Friedrich-Schiller-Universität, Jena, Germany;Friedrich-Schiller-Universität, Jena, Germany;Friedrich-Schiller-Universität, Jena, Germany;EMBL-EBI, Wellcome Trust Genome Campus, Hinxton, Cambridge, UK;EMBL-EBI, Wellcome Trust Genome Campus, Hinxton, Cambridge, UK

  • Venue:
  • BioNLP '09 Proceedings of the Workshop on Current Trends in Biomedical Natural Language Processing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We explore a rule system and a machine learning (ML) approach to automatically harvest information on gene regulation events (GREs) from biological documents in two different evaluation scenarios -- one uses self-supplied corpora in a clean lab setting, while the other incorporates a standard reference database of curated GREs from RegulonDB, real-life data generated independently from our work. In the lab condition, we test how feasible the automatic extraction of GREs really is and achieve F-scores, under different, not directly comparable test conditions though, for the rule and the ML systems which amount to 34% and 44%, respectively. In the RegulonDB condition, we investigate how robust both methodologies are by comparing them with this routinely used database. Here, the best F-scores for the rule and the ML systems amount to 34% and 19%, respectively.