Real-time object detection and localization with SIFT-based clustering

  • Authors:
  • Paolo Piccinini;Andrea Prati;Rita Cucchiara

  • Affiliations:
  • Department of Information Engineering, University of Modena and Reggio Emilia, Via Vignolese, 905/b, 41100 Modena, Italy;Department of Planning and Design of Complex Environments, University IUAV of Venice, Santa Croce 1957, 30135 Venezia, Italy;Department of Information Engineering, University of Modena and Reggio Emilia, Via Vignolese, 905/b, 41100 Modena, Italy

  • Venue:
  • Image and Vision Computing
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents an innovative approach for detecting and localizing duplicate objects in pick-and-place applications under extreme conditions of occlusion, where standard appearance-based approaches are likely to be ineffective. The approach exploits SIFT keypoint extraction and mean shift clustering to partition the correspondences between the object model and the image onto different potential object instances with real-time performance. Then, the hypotheses of the object shape are validated by a projection with a fast Euclidean transform of some delimiting points onto the current image. Moreover, in order to improve the detection in the case of reflective or transparent objects, multiple object models (of both the same and different faces of the object) are used and fused together. Many measures of efficacy and efficiency are provided on random disposals of heavily-occluded objects, with a specific focus on real-time processing. Experimental results on different and challenging kinds of objects are reported.