Automatic image annotation and semantic based image retrieval for medical domain

Authors:
Dumitru Dan Burdescu;Cristian Gabriel Mihai;Liana Stanescu;Marius Brezovan
Affiliations:
University of Craiova, Faculty of Automation, Computers and Electronics, Bvd. Decebal, No.107, Craiova, Romania;University of Craiova, Faculty of Automation, Computers and Electronics, Bvd. Decebal, No.107, Craiova, Romania;University of Craiova, Faculty of Automation, Computers and Electronics, Bvd. Decebal, No.107, Craiova, Romania;University of Craiova, Faculty of Automation, Computers and Electronics, Bvd. Decebal, No.107, Craiova, Romania
Venue:
Neurocomputing
Year:
2013

Citing 10
Cited 0

Visual information retrieval

Visual information retrieval
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary

ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Automatic image annotation and retrieval using cross-media relevance models

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Modeling annotated data

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach

IEEE Transactions on Pattern Analysis and Machine Intelligence
Matching words and pictures

The Journal of Machine Learning Research
Combining Visual Features with Semantics for a More Effective Image Retrieval

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 2 - Volume 02
Content-Based Image Query on Color Feature in the Image Databases Obtained from DICOM Files

ICCGI '06 Proceedings of the International Multi-Conference on Computing in the Global Information Technology
MPEG-7 as a Metadata Standard for Indexing of Surgery Videos in Medical E-Learning

ICCS '08 Proceedings of the 8th international conference on Computational Science, Part III
Handbook on Ontologies

Handbook on Ontologies

Quantified Score

Hi-index	0.01

Visualization

Abstract

Automatic image annotation is the process of assigning meaningful words to an image taking into account its content. This process is of great interest as it allows indexing, retrieving, and understanding of large collections of image data. This paper presents a system used in the medical domain for three distinct tasks: image annotation, semantic based image retrieval and content based image retrieval. An original image segmentation algorithm based on a hexagonal structure was used to perform the segmentation of medical images. Image's regions are described using a vocabulary of blobs generated from image features using the K-means clustering algorithm. The annotation and semantic based retrieval task is evaluated for two annotation models: Cross Media Relevance Model and Continuous-space Relevance Model. Semantic based image retrieval is performed using the methods provided by the annotation models. The ontology used by the annotation process was created in an original manner starting from the information content provided by the Medical Subject Headings (MeSH). The experiments were made using a database containing color images retrieved from medical domain using an endoscope and related to digestive diseases.