Semantic interpretation of novelty in images using histograms of oriented gradients

  • Authors:
  • Nicolas Alt;Werner Maier;Qing Rao;Eckehard Steinbach

  • Affiliations:
  • Institute for Media Technology, Technische Universität München, München, Germany;Institute for Media Technology, Technische Universität München, München, Germany;Institute for Media Technology, Technische Universität München, München, Germany;Institute for Media Technology, Technische Universität München, München, Germany

  • Venue:
  • ICIRA'12 Proceedings of the 5th international conference on Intelligent Robotics and Applications - Volume Part III
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

An approach for the semantic interpretation of image-based novelty in real-world environments is presented. We measure novelty using the concept of pixel-based surprise, which quantifies how much a new observation changes the robot's current probabilistic appearance model of the environment. The corresponding surprise maps are utilized as prior information to reduce the search space of a "Histograms of Oriented Gradients" object detector. Specifically, detection windows are scored and selected using surprise values. Several object classes are simultaneously searched for and learned from a low number of manually taken reference images. Experiments are performed on a human-size robot in a cluttered household environment. Compared to object detection based on a search of the complete image, a 35-fold speed-up is observed. Additionally, the detection performance increases significantly.