Maze hypothesis development in assessing robot performance during teleoperation
PerMIS '07 Proceedings of the 2007 Workshop on Performance Metrics for Intelligent Systems
Statistical Analysis and Data Mining
| Hi-index | 0.00 |
Over the past several years, the Department of Defense (DoD) has instituted a Technology Readiness Assessment (TRA) process based on NASA's Technology Readiness Levels (TRLs). The motivation was to ensure that technology development was complete and that performance was understood before entering into the System Development and Demonstration (SDD) phase of a program. Such a disciplined approach may aid in Intelligent Systems development. However, NASA's TRLs were derived in a context of hardware systems, and the hardware TRLs needed modification to treat software and software-intensive systems. This paper will examine under what conditions additional modifications might be necessary to treat Intelligent Systems. Technology development can only be "complete" in the context of a specific program with known performance requirements. Thus, the TRA's focus on critical technology elements (CTEs)---those technologies used in a new or novel way that are essential to system performance. These CTEs are assessed for their performance in a relevant environment, as determined from a consideration of the system's requirements. For Intelligent Systems, this focus on CTE's and relevant environment may provide a disciplined approach to ensuring technology maturity before system development. The algorithms that make decisions will often be the distinctive CTEs, unlike the CTEs of hardware systems. However, the major differences between Intelligent and hardware systems are likely to be in the "relevant environment". Intelligent Systems that develop and execute a course of action will, by their nature, present challenges in the definition of the "relevant environment". We will explore the effect of various degrees of "intelligence" on CTEs and the relevant environment in this paper.