The evolution of performance metrics in the RoboCup Rescue Virtual Robot Competition

Authors:
Stephen Balakirsky;Chris Scrapper;Stefano Carpin
Affiliations:
NIST, Gaithersburg, MD;NIST, Gaithersburg, MD;University of Calif. Merced, Merced, CA
Venue:
PerMIS '07 Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems
Year:
2007

Citing 2
Cited 3

RoboCup-98: Robot Soccer World Cup II

RoboCup-98: Robot Soccer World Cup II
Towards heterogeneous robot teams for disaster mitigation: Results and performance metrics from RoboCup rescue: Field Reports

Journal of Field Robotics - Special Issue on Teamwork in Field Robotics

Evaluating the RoboCup 2009 Virtual Robot Rescue Competition

PerMIS '09 Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
Evaluating speech translation systems: applying SCORE to TRANSTAC technologies

PerMIS '09 Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
Coordinated action in a heterogeneous rescue team

RoboCup 2009

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents an overview of the 2007 RoboCup Rescue Virtual Robot Competition and the performance metrics that were used to judge the competition. For this competition, great effort was placed in bringing together researchers with diverse interests to competitively participate. The competition arenas and metrics used for scoring were specifically designed to create a "level" playing field for the various research disciplines. The specific metrics, how they evolved from the prior year's competition, and the way in which the competition was run will be discussed in detail. Defects that were noted in the metrics will also be discussed.