Exploring text and image features to classify images in bioscience literature

Authors:
Barry Rafkind;Minsuk Lee;Shih-Fu Chang;Hong Yu
Affiliations:
Columbia University, New York, NY;University of Wisconsin-Milwaukee, Milwaukee, WI;Columbia University, New York, NY;University of Wisconsin-Milwaukee, Milwaukee, WI
Venue:
BioNLP '06 Proceedings of the Workshop on Linking Natural Language Processing and Biology: Towards Deeper Biological Literature Analysis
Year:
2006

Citing 5
Cited 8

Fundamentals of digital image processing

Fundamentals of digital image processing
Information Retrieval

Information Retrieval
Text Categorization with Suport Vector Machines: Learning with Many Relevant Features

ECML '98 Proceedings of the 10th European Conference on Machine Learning
Searching Online Journals for Fluorescence Microscope Images Depicting Protein Subcellular Location Patterns

BIBE '01 Proceedings of the 2nd IEEE International Symposium on Bioinformatics and Bioengineering
NLP found helpful (at least for one text categorization task)

EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10

Exploring the efficacy of caption search for bioscience journal search interfaces

BioNLP '07 Proceedings of the Workshop on BioNLP 2007: Biological, Translational, and Clinical Language Processing
Figure classification in biomedical literature to elucidate disease mechanisms, based on pathways

Artificial Intelligence in Medicine
Invited paper: Structured literature image finder: Parsing text and figures in biomedical literature

Web Semantics: Science, Services and Agents on the World Wide Web
Detecting hedge cues and their scope in biomedical text with conditional random fields

Journal of Biomedical Informatics
Structured literature image finder: extracting information from text and images in biomedical literature

ISMB/ECCB'09 Proceedings of the 2009 workshop of the BioLink Special Interest Group, international conference on Linking Literature, Information, and Knowledge for Biology
Automatic figure classification in bioscience literature

Journal of Biomedical Informatics
OCR-based image features for biomedical image and article classification: identifying documents relevant to cis-regulatory elements

Proceedings of the ACM Conference on Bioinformatics, Computational Biology and Biomedicine
Bag---of---Colors for biomedical document image classification

MCBR-CDS'12 Proceedings of the Third MICCAI international conference on Medical Content-Based Retrieval for Clinical Decision Support

Quantified Score

Hi-index	0.00

Visualization

Abstract

A picture is worth a thousand words. Biomedical researchers tend to incorporate a significant number of images (i.e., figures or tables) in their publications to report experimental results, to present research models, and to display examples of biomedical objects. Unfortunately, this wealth of information remains virtually inaccessible without automatic systems to organize these images. We explored supervised machine-learning systems using Support Vector Machines to automatically classify images into six representative categories based on text, image, and the fusion of both. Our experiments show a significant improvement in the average F-score of the fusion classifier (73.66%) as compared with classifiers just based on image (50.74%) or text features (68.54%).