Principles and guidelines for the design of eye/voice interaction dialogs

  • Authors:
  • F. Hatfield;E. A. Jenkins;M. W. Jennings;G. Calhoun

  • Affiliations:
  • -;-;-;-

  • Venue:
  • HICS '96 Proceedings of the 3rd Symposium on Human Interaction with Complex Systems (HICS '96)
  • Year:
  • 1996

Quantified Score

Hi-index 0.00

Visualization

Abstract

Pilots and operators of advanced military systems need better ways of interacting with their systems, including more efficient human-machine dialog and better physical interface devices and interaction techniques. The goal of the Eye/Voice Mission Planning Interface (EVMPI) research is to integrate voice recognition and eye-tracking technology with aviation displays in order to reduce the pilot's cognitive and manual workload. In its current state of development, the EVMPI technology allows an operator to gaze on user interface items of interest and issue verbal commands/queries that can be interpreted by the system, thus permitting hands-free operation of cockpit displays. This paper describes the concept for the EVMPI, presents general principles for integrating eye gaze and voice input in the form of human-computer interaction dialogs, and describes the architecture and current implementation of the system.