Optimizing visual vocabularies using soft assignment entropies

  • Authors:
  • Yubin Kuang;Kalle Åström;Lars Kopp;Magnus Oskarsson;Martin Byröd

  • Affiliations:
  • Centre for Mathematical Sciences, Lund University;Centre for Mathematical Sciences, Lund University;Centre for Mathematical Sciences, Lund University;Centre for Mathematical Sciences, Lund University;Centre for Mathematical Sciences, Lund University

  • Venue:
  • ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

The state of the art for large database object retrieval in images is based on quantizing descriptors of interest points into visual words. High similarity between matching image representations (as bags of words) is based upon the assumption that matched points in the two images end up in similar words in hard assignment or in similar representations in soft assignment techniques. In this paper we study how ground truth correspondences can be used to generate better visual vocabularies. Matching of image patches can be done e.g. using deformable models or from estimating 3D geometry. For optimization of the vocabulary, we propose minimizing the entropies of soft assignment of points. We base our clustering on hierarchical k-splits. The results from our entropy based clustering are compared with hierarchical k-means. The vocabularies have been tested on real data with decreased entropy and increased true positive rate, as well as better retrieval performance.