Optical Brain Imaging to Enhance UAV Operator Training, Evaluation, and Interface Development

  • Authors:

  • Justin Menda;James T. Hing;Hasan Ayaz;Patricia A. Shewokis;Kurtulus Izzetoglu;Banu Onaral;Paul Oh

  • Affiliations:

  • School of Biomedical Engineering, Science & Health Systems, Drexel University, Philadelphia, USA;Department of Mechanical Engineering and Mechanics, Drexel University, Philadelphia, USA;School of Biomedical Engineering, Science & Health Systems, Drexel University, Philadelphia, USA;School of Biomedical Engineering, Science & Health Systems, Drexel University, Philadelphia, USA;School of Biomedical Engineering, Science & Health Systems, Drexel University, Philadelphia, USA;School of Biomedical Engineering, Science & Health Systems, Drexel University, Philadelphia, USA;Department of Mechanical Engineering and Mechanics, Drexel University, Philadelphia, USA

  • Venue:
  • Journal of Intelligent and Robotic Systems
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

As the use of unmanned aerial vehicles expands to near earth applications and force multiplying scenarios, current methods of operating UAVs and evaluating pilot performance need to expand as well. Many human factors studies on UAV operations rely on self reporting surveys to assess the situational awareness and cognitive workload of an operator during a particular task, which can make objective evaluations difficult. Functional Near-Infrared Spectroscopy (fNIR) is an emerging optical brain imaging technology that monitors brain activity in response to sensory, motor, or cognitive activation. fNIR systems developed during the last decade allow for a rapid, non-invasive method of measuring the brain activity of a subject while conducting tasks in realistic environments. This paper investigates deployment of fNIR for monitoring UAV operator's cognitive workload and situational awareness during simulated missions. The experimental setup and procedures are presented with some early results supporting the use of fNIR for enhancing UAV operator training, evaluation and interface development.