Model-based and learned semantic object labeling in 3D point cloud maps of kitchen environments

  • Authors:
  • Radu Bogdan Rusu;Zoltan Csaba Marton;Nico Blodow;Andreas Holzbach;Michael Beetz

  • Affiliations:
  • Intelligent Autonomous Systems, Technische Universität München, Garching bei München, Germany;Intelligent Autonomous Systems, Technische Universität München, Garching bei München, Germany;Intelligent Autonomous Systems, Technische Universität München, Garching bei München, Germany;Intelligent Autonomous Systems, Technische Universität München, Garching bei München, Germany;Intelligent Autonomous Systems, Technische Universität München, Garching bei München, Germany

  • Venue:
  • IROS'09 Proceedings of the 2009 IEEE/RSJ international conference on Intelligent robots and systems
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We report on our experiences regarding the acquisition of hybrid Semantic 3D Object Maps for indoor household environments, in particular kitchens, out of sensed 3D point cloud data. Our proposed approach includes a processing pipeline, including geometric mapping and learning, for processing large input datasets and for extracting relevant objects useful for a personal robotic assistant to perform complex manipulation tasks. The type of objects modeled are objects which perform utilitarian functions in the environment such as kitchen appliances, cupboards, tables, and drawers. The resulted model is accurate enough to use it in physics-based simulations, where doors of 3D containers can be opened based on their hinge position. The resulted map is represented as a hybrid concept and is comprised of both the hierarchically classified objects and triangular meshes used for collision avoidance in manipulation routines.