A RELIEF-based modality weighting approach for multimodal information retrieval

  • Authors:
  • Turgay Yilmaz;Elvan Gulen;Adnan Yazici;Masaru Kitsuregawa

  • Affiliations:
  • Middle East Technical Univ., Ankara, Turkey;Middle East Technical Univ., Ankara, Turkey;Middle East Technical Univ., Ankara, Turkey;University of Tokyo, Tokyo, Japan

  • Venue:
  • Proceedings of the 2nd ACM International Conference on Multimedia Retrieval
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Despite the extensive number of studies for multimodal information fusion, the issue of determining the optimal modalities has not been adequately addressed yet. In this study, a RELIEF-based multimodal feature selection approach (RELIEF-RDR) is proposed. The original RELIEF algorithm is extended for weaknesses in three major issues; multi-labeled data, noise and class-specific feature selection. To overcome these weaknesses, discrimination based weighting mechanism of RELIEF is supported with two additional concepts; representation and reliability capabilities of features, without an increase in computational complexity. These capabilities of features are exploited by using the statistics on dissimilarities of training instances. The experiments conducted on TRECVID 2007 dataset validated the superiority of RELIEF-RDR over RELIEF.