RoboCup: The Robot World Cup Initiative
AGENTS '97 Proceedings of the first international conference on Autonomous agents
A Robust Speech Recognition System for Service-Robotics Applications
RoboCup 2008: Robot Soccer World Cup XII
Imagery of disabled people within social robotics research
ICSR'12 Proceedings of the 4th international conference on Social Robotics
Development of RoboCup @home simulator: simulation platform that enables long-term large scale HRI
Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
| Hi-index | 0.00 |
RoboCup@Home is the largest benchmarking effort for domestic service robots. The benchmarking is in the form of a competition, with several yearly local competitions and an international one. Every year the tests become more complex, depending on the results of the previous years. In the past four years the focus has been on benchmarking physical aspects of the robots, such as manipulation, recognizing people and human-robot interaction. In 2010, for the first time, there is a test which is targeted at the mental cognitive capabilities of the robot. In order to guarantee scientific quality of the proposed solutions and effective integration in a fully working system, all the tests include different capabilities and change every year. This novel feature of RoboCup@Home benchmarking raises the question of: How can effective benchmark tests be defined and at the same time measure the progress over many years? In this paper we present the methodology applied in and results of RoboCup@Home for measuring the effectiveness of benchmarking service robots through competitions and present a new integrated test for benchmarking the cognitive abilities of a robot.