Semantics and CBIR: a medical imaging perspective

  • Authors:
  • Xiang Sean Zhou;Sonja Zillner;Manuel Moeller;Michael Sintek;Yiqiang Zhan;Arun Krishnan;Alok Gupta

  • Affiliations:
  • Siemens Medical Solutions, Malvern, PA, USA;Siemens Corporate Technology, Munich, Germany;DFKI, Germany;DFKI, Germany;Siemens Medical Solutions, Malvern, PA, USA;Siemens Medical Solutions, Malvern, PA, USA;Siemens Medical Solutions, Malvern, PA, USA

  • Venue:
  • CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Medical CBIR (content-based image retrieval) applications pose unique challenges but at the same time offer many new opportunities. On one hand, while one can easily understand news or sports videos, a medical image is often completely incomprehensible to untrained eyes. On the other hand, semantics in the medical domain is much better defined and there is a vast accumulation of formal knowledge representations that could be exploited to support semantic search for any specialty areas in medicine. In this paper, however, we will not dwell on any one particular specialty area, but rather address the question of how to support scalable semantic search across the whole of medical CBIR field: what are the advantages to take and gaps to fill, what are the key enabling technologies, and the critical success factor from an industrial point of view. In terms of enabling technologies, we discuss three aspects: 1. anatomical, disease, and contextual semantics, and their representations using ontologies; 2. scalable image analysis and tagging algorithms; and 3. ontological reasoning and its role in guiding and improving image analysis and retrieval. More specifically, for ontological representation of medical imaging semantics, we discuss the potential use of FMA, RadLex, ICD, and AIM. For scalable image analysis we present a learning-based anatomy detection and segmentation framework using distribution-free priors. It is easily adaptable to different anatomies and different imaging modalities.