Leaving Flatland: Realtime 3D Stereo Semantic Reconstruction

  • Authors:
  • Radu Bogdan Rusu;Aravind Sundaresan;Benoit Morisset;Motilal Agrawal;Michael Beetz

  • Affiliations:
  • Artificial Intelligence Center, SRI International, Menlo Park, USA CA 94025 and Intelligent Autonomous Systems, Technische Universität München, Garching b. München, Germany D-85748;Artificial Intelligence Center, SRI International, Menlo Park, USA CA 94025;Artificial Intelligence Center, SRI International, Menlo Park, USA CA 94025;Artificial Intelligence Center, SRI International, Menlo Park, USA CA 94025;Intelligent Autonomous Systems, Technische Universität München, Garching b. München, Germany D-85748

  • Venue:
  • ICIRA '08 Proceedings of the First International Conference on Intelligent Robotics and Applications: Part I
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

We report our first experiences with Leaving Flatland, an exploratory project which studies the key challenges in closing the loop on autonomous perception and action in challenging terrain. A primary objective of the project is to demonstrate the acquisition and processing of robust 3D geometric model maps from stereo data and Visual Odometry techniques. The 3D geometric model is used to infer different terrain types and construct a 3D semantic model which can be used for path planning or teleoperation. This paper presents the set of methods and techniques used for building such a model, and provides insight on the mathematical optimizations used for obtaining realtime processing. To validate our approach, we show results obtained on multiple datasets and perform a comparison with other similar initiatives.