Validating neural network-based online adaptive systems: a case study

  • Authors:
  • Yan Liu;Bojan Cukic;Srikanth Gururajan

  • Affiliations:
  • Motorola Labs, Motorola Inc, Schaumburg, USA;Lane Department of Computer Science and Electrical Engineering, West Virginia University, Morgantown, USA;Mechanical and Aerospace Engineering Department, West Virginia University, Morgantown, USA

  • Venue:
  • Software Quality Control
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Biologically inspired soft computing paradigms such as neural networks are popular learning models adopted in online adaptive systems for their ability to cope with the demands of a changing environment. However, continual changes induce uncertainty that limits the applicability of conventional validation techniques to assure the reliable performance of such systems. In this paper, we discuss a dynamic approach to validate the adaptive system component. Our approach consists of two run-time techniques: (1) a statistical learning tool that detects unforeseen data; and (2) a reliability measure of the neural network output after it accommodates the environmental changes. A case study on NASA F-15 flight control system demonstrates that our techniques effectively detect unusual events and provide validation inferences in a real-time manner.