Multimodal Human-Computer Interaction for Crisis Management Systems

  • Authors:
  • N. Krahnstoever;E. Schapira;S. Kettebekov;R. Sharma

  • Affiliations:
  • -;-;-;-

  • Venue:
  • WACV '02 Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a multimodal crisis management system(XISM). It employs processing of natural gesture andspeech commands elicited by a user to efficiently managecomplex dynamic emergency scenarios on a large display.The developed prototype system demonstrates the means ofincorporating unconstrained free-hand gestures andspeech in a real-time interactive interface.This paper provides insights into the design aspects of theXISM system. In particular, it addresses the issues of extractionand fusion of gesture and speech modalities toallow more natural interactive behavior. Performancecharacteristics of the current prototype and considerationsfor future work are discussed. A series of studies indicatedpositive response with respect to ease of interacting withthe current system.