Image modality classification: a late fusion method based on confidence indicator and closeness matrix

  • Authors:
  • Xingzhi Sun;Leiguang Gong;Apostol Natsev;Xiaofei Teng;Li Tian;Tao Wang;Yue Pan

  • Affiliations:
  • IBM Research - China, Zhongguancun Software Park Beijing, China;IBM Watson Research Center, Skyline Drive, Hawthorne NY;IBM Watson Research Center, Skyline Drive, Hawthorne NY;IBM Research - China, Zhongguancun Software Park Beijing, China;Shanghai Jiao Tong University, Shanghai, China;IBM Research - China, Zhongguancun Software Park Beijing, China;IBM Research - China, Zhongguancun Software Park Beijing, China

  • Venue:
  • Proceedings of the 1st ACM International Conference on Multimedia Retrieval
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Automatic recognition or classification of medical image modality can provide valuable information for medical image retrieval and analysis. In this paper, we discuss an application of SVM ensemble classifiers to the problem, and explore a confidence indicator based late fusion method to resolve ambiguity across competing classes. Using a matrix of closeness and a set of additional fusion rules, the proposed method improves the classification performance by only subjecting likely misclassified samples to a text-based classifier followed by additional fusion of both image-based classification and text-based classification results. An empirical evaluation using standard ImageClef2010 Medical Retrieval data show very promising performance for the proposed approach.