Capturing high-level image concepts via affinity relationships in image database retrieval

  • Authors:
  • Mei-Ling Shyu;Shu-Ching Chen;Min Chen;Chengcui Zhang;Kanoksri Sarinnapakorn

  • Affiliations:
  • Department of Electrical and Computer Engineering, University of Miami, Coral Gables, USA 33124;Distributed Multimedia Information System Laboratory, School of Computer Science, Florida International University, Miami, USA 33199;Distributed Multimedia Information System Laboratory, School of Computer Science, Florida International University, Miami, USA 33199;Department of Computer and Information Science, University of Alabama at Birmingham, Birmingham, USA 35294;Department of Electrical and Computer Engineering, University of Miami, Coral Gables, USA 33124

  • Venue:
  • Multimedia Tools and Applications
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a mechanism called Markov Model Mediator (MMM) to facilitate the efficient and effective capturing of high-level image concepts in content-based image retrieval (CBIR). MMM serves as the retrieval engine of the CBIR system and uses affinity-based similarity measures. This mechanism is effective in capturing subjective user concepts in that it not only takes into consideration the global image features, but also learns the high-level concepts of the images from the history of user access patterns and access frequencies on the images in the image database, which differentiates it from the common methods in CBIR. The advantage of our proposed mechanism is that it exploits the richness in the structured description of visual contents as well as the relative affinity relationships among the images. Consequently, it provides the capability to bridge the gap between the low-level features and the high-level concepts. This mechanism is also efficient in that it integrates Principal Component Analysis (PCA) to significantly reduce the image search space at a low cost before performing exact similarity matching. An off-line training subsystem for this framework was implemented and integrated into our system. The experimental results demonstrate that MMM can effectively capture user's high-level concept more quickly.