Comparison of mid-level feature coding approaches and pooling strategies in visual concept detection

  • Authors:

  • Piotr Koniusz;Fei Yan;Krystian Mikolajczyk

  • Affiliations:

  • Centre for Vision, Speech and Signal Processing, University of Surrey, GU2 7XH Guildford, UK;Centre for Vision, Speech and Signal Processing, University of Surrey, GU2 7XH Guildford, UK;Centre for Vision, Speech and Signal Processing, University of Surrey, GU2 7XH Guildford, UK

  • Venue:
  • Computer Vision and Image Understanding
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Bag-of-Words lies at a heart of modern object category recognition systems. After descriptors are extracted from images, they are expressed as vectors representing visual word content, referred to as mid-level features. In this paper, we review a number of techniques for generating mid-level features, including two variants of Soft Assignment, Locality-constrained Linear Coding, and Sparse Coding. We also isolate the underlying properties that affect their performance. Moreover, we investigate various pooling methods that aggregate mid-level features into vectors representing images. Average pooling, Max-pooling, and a family of likelihood inspired pooling strategies are scrutinised. We demonstrate how both coding schemes and pooling methods interact with each other. We generalise the investigated pooling methods to account for the descriptor interdependence and introduce an intuitive concept of improved pooling. We also propose a coding-related improvement to increase its speed. Lastly, state-of-the-art performance in classification is demonstrated on Caltech101, Flower17, and ImageCLEF11 datasets.