X-ray image categorization and retrieval using patch-based visual words representation

  • Authors:
  • Uri Avni;Hayit Greenspan;Michal Sharon;Eli Konen;Jacob Goldberger

  • Affiliations:
  • BioMedical Engineering, Tel-Aviv University;IBM Almaden Research Center, San Jose, CA and BioMedical Engineering, Tel-Aviv University;Diagnostic Imaging Department, Sheba Medical Center;Diagnostic Imaging Department, Sheba Medical Center;School of Engineering, Bar-Ilan University

  • Venue:
  • ISBI'09 Proceedings of the Sixth IEEE international conference on Symposium on Biomedical Imaging: From Nano to Macro
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present an efficient image categorization and retrieval system applied to medical image databases, in particular large radiograph archives. The methodology presented is based on local patch representation of the image content and a bag-of-features approach for defining image categories, with a kernel based SVM classifier. In a recent international competition the system was ranked as one of the top schemes in discriminating orientation and body regions in x-ray images, and in medical visual retrieval. A detailed description of the method (not previously published) is presented, along with its most recent results. In addition to organ-level discrimination, we show initial results of pathology-level categorization of chest x-ray data. On a set of 102 chest radiographs taken from routine hospital examination, the system detects pathology with sensitivity of 94% and specificity of 91%. We view this as a first step towards similarity-based categorization with clinical importance in computer-assisted diagnostics.