Evaluation of RoboCup maps

  • Authors:
  • Benjamin Balaguer;Stefano Carpin;Stephen Balakirsky;Arnoud Visser

  • Affiliations:
  • University of California, Merced;University of California, Merced;NIST, Gaithersburg, MD;Universiteit van Amsterdam, XG, Amsterdam, NL

  • Venue:
  • PerMIS '09 Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes the steps taken to create the scoring criteria aimed at measuring the quality of maps produced by teams participating in the RoboCup Rescue Virtual Robots competition. Since metrics have already been developed by a few research groups, we start by highlighting the most popular solutions to this problem, emphasizing their strengths and weaknesses. Having put the difficulty of creating map benchmarks into perspective, we present our map benchmark suite, appropriate for Urban Search and Rescue missions, along with examples taken from former competitions.