Probabilistic categorization of kitchen objects in table settings with a composite sensor

Authors:
Zoltan-Csaba Marton;Radu Bogdan Rusu;Dominik Jain;Ulrich Klank;Michael Beetz
Affiliations:
Intelligent Autonomous Systems, Computer Science Department, Technische Universität München, Garching bei München, Germany;Intelligent Autonomous Systems, Computer Science Department, Technische Universität München, Garching bei München, Germany;Intelligent Autonomous Systems, Computer Science Department, Technische Universität München, Garching bei München, Germany;Intelligent Autonomous Systems, Computer Science Department, Technische Universität München, Garching bei München, Germany;Intelligent Autonomous Systems, Computer Science Department, Technische Universität München, Garching bei München, Germany
Venue:
IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
Year:
2009

Citing 10
Cited 4

Data mining: practical machine learning tools and techniques with Java implementations

Data mining: practical machine learning tools and techniques with Java implementations
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Discriminative Learning of Markov Random Fields for Segmentation of 3D Scan Data

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 2 - Volume 02
Markov logic networks

Machine Learning
Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning)

Introduction to Statistical Relational Learning (Adaptive Computation and Machine Learning)
MEBN: A language for first-order Bayesian knowledge bases

Artificial Intelligence
Motion Segmentation and Depth Ordering Using an Occlusion Detector

IEEE Transactions on Pattern Analysis and Machine Intelligence
Combining Time-Of-Flight depth and stereo images without accurate extrinsic calibration

International Journal of Intelligent Systems Technologies and Applications
On fast surface reconstruction methods for large and noisy point clouds

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation
Leaving flatland: toward real-time 3D navigation

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation

Object categorization in clutter using additive features and hashing of part-graph descriptors

SC'12 Proceedings of the 2012 international conference on Spatial Cognition VIII
Efficient object categorization with the surface-approximation polynomials descriptor

SC'12 Proceedings of the 2012 international conference on Spatial Cognition VIII
Towards a comprehensive chore list for domestic robots

Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
Structure-based object representation and classification in mobile robotics through a Microsoft Kinect

Robotics and Autonomous Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we investigate the problem of 3D object categorization of objects typically present in kitchen environments, from data acquired using a composite sensor. Our framework combines different sensing modalities and defines descriptive features in various spaces for the purpose of learning good object models. By fusing the 3D information acquired from a composite sensor that includes a color stereo camera, a time-of-flight (TOF) camera, and a thermal camera, we augment 3D depth data with color and temperature information which helps disambiguate the object categorization process. We make use of statistical relational learning methods (Markov Logic Networks and Bayesian Logic Networks) to capture complex interactions between the different feature spaces. To show the effectiveness of our approach, we analyze and validate the proposed system for the problem of recognizing objects in table settings scenarios.