Mobile robotic surveying performance for planetary surface site characterization
PerMIS '08 Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems
Measuring robot performance in real-time for NASA robotic reconnaissance operations
PerMIS '09 Proceedings of the 9th Workshop on Performance Metrics for Intelligent Systems
Journal of Intelligent and Robotic Systems
General systems performance theory and its application to understanding complex system performance
Information-Knowledge-Systems Management - Complex Socio-Technical Systems --Understanding and Influencing Causality of Change
| Hi-index | 0.00 |
The concept of operational performance metrics and associated measurement issues is explored for deployed robotic systems. The focus is on performance of mobility and robotic arm autonomy exercised on the NASA Mars Exploration Rovers surface mission. This planetary rover mission has been underway for nearly 3 years since January 2004 using two rovers performing separate missions. The autonomy functions of surface navigation, short-distance approach to surface science targets, and robotic placement of armmounted instruments on science targets are considered. Operational metrics that measure performance of these functions relative to system requirements are advocated. Specific metrics are defined and computed using telemetry from the rovers' multiyear operations on Mars and applied to rate performance during their respective missions. An existing methodology is applied to compute metrics with respect to required performance and to aggregate multiple metrics into a composite performance score for each rover. The formulation is augmented to accommodate importance weights that add flexibility in use of the metrics by different potential endusers, e.g., sponsors, program managers, systems engineers, and technologists. A brief example illustrates the application and effect of importance weights on overall rover performance scores. © 2007 Wiley Periodicals, Inc.