Boosting contextual information in content-based image retrieval

• Authors: Jaume Amores;Nicu Sebe;Petia Radeva;Theo Gevers;Arnold Smeulders
• Venue: Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval
• Year: 2004

We present a new framework for characterizing and retrieving objects in cluttered scenes. Objects are best represented by characterizing both their parts and the mutual spatial relations among them. This CBIR system is based on a new representation describing every object taking into account the local properties of its parts and their mutual spatial relations, without relying on accurate segmentation. For this purpose, a new multi-dimensional histogram is used that measures the joint distribution of local properties and relative spatial positions. Instead of using a single descriptor for all the image, we represent the image by a set of histograms covering the object from different perspectives. We integrate this representation in a whole framework which has two stages. The first one is to allow an efficient retrieval based on the geometric properties (shape) of objects in images with clutter. This is achieved by i) using a contextual descriptor that incorporates the distribution of local structures, and ii) taking a proper distance that disregards the clutter of the images. At a second stage, we introduce a more discriminative descriptor that characterizes the parts of the objects by their color and their local tructure. By sing relevant-feedback and boosting as a feature selection algorithm, the system is able to learn simultaneously the information that characterize each part of the object along with their mutual spatial relations. Results are reported on two known databases and are quantitatively compared to other successful approaches