Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes

Authors:
Ajmal S. Mian;Mohammed Bennamoun;Robyn Owens
Affiliations:
-;-;-
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2006

Citing 25
Cited 34

Marching cubes: A high resolution 3D surface construction algorithm

SIGGRAPH '87 Proceedings of the 14th annual conference on Computer graphics and interactive techniques
Computer graphics: principles and practice (2nd ed.)

Computer graphics: principles and practice (2nd ed.)
CAD-Based Computer Vision: From CAD Models to Relational Graphs

IEEE Transactions on Pattern Analysis and Machine Intelligence
Structural Indexing: Efficient 3-D Object Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
A Method for Registration of 3-D Shapes

IEEE Transactions on Pattern Analysis and Machine Intelligence - Special issue on interpretation of 3-D scenes—part II
Part II: 3-D Object Recognition and Shape Estimation from Image Contours Using B-splines, Shape Invariant Matching, and Neural Network

IEEE Transactions on Pattern Analysis and Machine Intelligence
A volumetric method for building complex models from range images

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Surface simplification using quadric error metrics

Proceedings of the 24th annual conference on Computer graphics and interactive techniques
COSMOS-A Representation Scheme for 3D Free-Form Objects

IEEE Transactions on Pattern Analysis and Machine Intelligence
Point Signatures: A New Representation for 3D Object Recognition

International Journal of Computer Vision
Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes

IEEE Transactions on Pattern Analysis and Machine Intelligence
RANSAC-Based DARCES: A New Approach to Fast Automatic Registration of Partially Overlapping Range Images

IEEE Transactions on Pattern Analysis and Machine Intelligence
Simultaneous registration of multiple corresponding point sets

Computer Vision and Image Understanding
A survey of free-form object representation and recognition techniques

Computer Vision and Image Understanding
Machine Vision for Three-Dimensional Scenes

Machine Vision for Three-Dimensional Scenes
The Complex EGI: A New Representation for 3-D Pose Determination

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Spherical Representation for Recognition of Free-Form Surfaces

IEEE Transactions on Pattern Analysis and Machine Intelligence
From Unordered Range Images to 3D Models: A Fully Automatic Multiview Correspondence Algorithm

TPCG '04 Proceedings of the Theory and Practice of Computer Graphics 2004 (TPCG'04)
3D Recognition and Segmentation of Objects in Cluttered Scenes

WACV-MOTION '05 Proceedings of the Seventh IEEE Workshops on Application of Computer Vision (WACV/MOTION'05) - Volume 1 - Volume 01
Automatic Class Selection and Prototyping for 3-D Object Classification

3DIM '05 Proceedings of the Fifth International Conference on 3-D Digital Imaging and Modeling
A Novel Representation and Feature Matching Algorithm for Automatic Pairwise Registration of Range Images

International Journal of Computer Vision
Large data sets and confusing scenes in 3-D surface matching and recognition

3DIM'99 Proceedings of the 2nd international conference on 3-D digital imaging and modeling
Parts-based 3D object classification

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
Linear model hashing and batch RANSAC for rapid and accurate object recognition

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
3D modeling using a statistical sensor model and stochastic search

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition

Integration of local and global geometrical cues for 3D face recognition

Pattern Recognition
An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Keypoint Detection and Local Feature Matching for Textured 3D Face Recognition

International Journal of Computer Vision
Vision for Robotics

Foundations and Trends in Robotics
Surface signature-based method for modeling and recognizing free-form objects

ISVC'07 Proceedings of the 3rd international conference on Advances in visual computing - Volume Part II
Real-time Object Recognition in Sparse Range Images Using Error Surface Embedding

International Journal of Computer Vision
On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes

International Journal of Computer Vision
Viewpoint independent object recognition in cluttered scenes exploiting ray-triangle intersection and SIFT algorithms

Pattern Recognition
Fast and automatic object pose estimation for range images on the GPU

Machine Vision and Applications - Integrated Imaging and Vision Techniques for Industrial Inspection
Orientation invariant 3D object classification using hough transform based methods

Proceedings of the ACM workshop on 3D object retrieval
Hough transform and 3D SURF for robust three dimensional classification

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part VI
Local shape descriptor selection for object recognition in range data

Computer Vision and Image Understanding
An efficient RANSAC for 3D object recognition in noisy and occluded scenes

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part I
Continuous surface-point distributions for 3D object pose estimation and recognition

ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part III
3D scene retrieval and recognition with Depth Gradient Images

Pattern Recognition Letters
Semi-supervised segmentation of 3D surfaces using a weighted graph representation

GbRPR'11 Proceedings of the 8th international conference on Graph-based representations in pattern recognition
Scene parsing using a prior world model

International Journal of Robotics Research
Model-based object recognition from 3D laser data

KI'11 Proceedings of the 34th Annual German conference on Advances in artificial intelligence
Rigid 3D geometry matching for grasping of known objects in cluttered scenes

International Journal of Robotics Research
3D Geometric Scale Variability in Range Images: Features and Descriptors

International Journal of Computer Vision
Real-time object detection and localization with SIFT-based clustering

Image and Vision Computing
An efficient 3D face recognition approach based on the fusion of novel local low-level features

Pattern Recognition
A graph-based technique for semi-supervised segmentation of 3D surfaces

Pattern Recognition Letters
Hierarchical Normal Space Sampling to speed up point cloud coarse matching

Pattern Recognition Letters
Object categorization in clutter using additive features and hashing of part-graph descriptors

SC'12 Proceedings of the 2012 international conference on Spatial Cognition VIII
A global hypotheses verification method for 3d object recognition

ECCV'12 Proceedings of the 12th European conference on Computer Vision - Volume Part III
A Scale Independent Selection Process for 3D Object Recognition in Cluttered Scenes

International Journal of Computer Vision
3D partial surface matching using differential geometry and statistical approaches

IScIDE'12 Proceedings of the third Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
Model based training, detection and pose estimation of texture-less 3d objects in heavily cluttered scenes

ACCV'12 Proceedings of the 11th Asian conference on Computer Vision - Volume Part I
Special Section on 3D Object Retrieval: Evaluating 3D spatial pyramids for classifying 3D shapes

Computers and Graphics
Special Section on 3D Object Retrieval: Efficient 3D object recognition using foveated point clouds

Computers and Graphics
Consensus strategy for clustering using RC-images

Pattern Recognition
Structure-based object representation and classification in mobile robotics through a Microsoft Kinect

Robotics and Autonomous Systems
Demisting the Hough Transform for 3D Shape Recognition and Registration

International Journal of Computer Vision

Quantified Score

Hi-index	0.14

Visualization

Abstract

Viewpoint independent recognition of free-form objects and their segmentation in the presence of clutter and occlusions is a challenging task. We present a novel 3D model-based algorithm which performs this task automatically and efficiently. A 3D model of an object is automatically constructed offline from its multiple unordered range images (views). These views are converted into multidimensional table representations (which we refer to as tensors). Correspondences are automatically established between these views by simultaneously matching the tensors of a view with those of the remaining views using a hash table-based voting scheme. This results in a graph of relative transformations used to register the views before they are integrated into a seamless 3D model. These models and their tensor representations constitute the model library. During online recognition, a tensor from the scene is simultaneously matched with those in the library by casting votes. Similarity measures are calculated for the model tensors which receive the most votes. The model with the highest similarity is transformed to the scene and, if it aligns accurately with an object in the scene, that object is declared as recognized and is segmented. This process is repeated until the scene is completely segmented. Experiments were performed on real and synthetic data comprised of 55 models and 610 scenes and an overall recognition rate of 95 percent was achieved. Comparison with the spin images revealed that our algorithm is superior in terms of recognition rate and efficiency.