Evaluating the RoboCup 2009 Virtual Robot Rescue Competition

Authors:
Stephen Balakirsky;Stefano Carpin;Arnoud Visser
Affiliations:
NIST, Gaithersburg, MD;University of California, Merced, Merced, CA;Universiteit van Amsterdam, Amsterdam, NL
Venue:
PerMIS '09 Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
Year:
2009

Citing 6
Cited 3

Robot Motion Planning

Robot Motion Planning
RoboCup-97: Robot Soccer World Cup I

RoboCup-97: Robot Soccer World Cup I
Applying SCORE to field-based performance evaluations of soldier worn sensor technologies: Field Reports

Journal of Field Robotics
Determining Map Quality through an Image Similarity Metric

RoboCup 2008: Robot Soccer World Cup XII
Evaluating maps produced by urban search and rescue robots: lessons learned from RoboCup

Autonomous Robots
The evolution of performance metrics in the RoboCup Rescue Virtual Robot Competition

PerMIS '07 Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems

The role of competitions in advancing intelligent systems: a practitioner's perspective

PerMIS '09 Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
Evaluation of RoboCup maps

PerMIS '09 Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
Realistic simulation of laser range finder behavior in a smoky environment

RoboCup 2010

Quantified Score

Hi-index	0.00

Visualization

Abstract

The 2009 RoboCup Competitions took place in Graz, Austria in July of 2009. The Virtual Robot Rescue Competition included 11 competitors from 10 different countries. The main objective of this competition is to utilize teams of robots to perform an urban search and rescue (USAR) mission over both indoor and outdoor terrains. For the first time, elemental tests were performed in autonomously generated map quality, multi-vehicle tele-operation, and communication's system deployment. In addition, a comprehensive USAR scenario was performed. This year's competition featured new performance metrics and automatic scoring programs. This paper presents an overview of the metrics for the competitions and lessons learned from their application during a high-intensity international competition.