Annotation-based expansion and late fusion of mixed methods for multimedia image retrieval

  • Authors:
  • Hugo Jair Escalante;Jesús A. Gonzalez;Carlos A. Hernández;Aurelio López;Manuel Montes;Eduardo Morales;Luis E. Sucar;Luis Villaseñor-Pineda

  • Affiliations:
  • Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, México;Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, México;Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, México;Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, México;Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, México;Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, México;Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, México;Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, México

  • Venue:
  • CLEF'08 Proceedings of the 9th Cross-language evaluation forum conference on Evaluating systems for multilingual and multimodal information access
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes experimental results of two approaches to multimedia image retrieval: annotation-based expansion and late fusion of mixed methods. The former formulation consists of expanding manual annotations with labels generated by automatic annotation methods. Experimental results show that the performance of text-based methods can be improved with this strategy, specially, for visual topics; motivating further research in several directions. The second approach consists of combining the outputs of diverse image retrieval models based on different information. Experimental results show that competitive performance, in both retrieval and results diversification, can be obtained with this simple strategy. It is interesting that, contrary to previous work, the best results of the fusion were obtained by assigning a high weight to visual methods. Furthermore, a probabilistic modeling approach to result-diversification is proposed; experimental results reveal that some modifications are needed to achieve satisfactory results with this method.