Towards high-level human activity recognition through computer vision and temporal logic

  • Authors:
  • Joris Ijsselmuiden;Rainer Stiefelhagen

  • Affiliations:
  • Fraunhofer IOSB Karlsruhe;Fraunhofer IOSB Karlsruhe and Institute for Anthropomatics, Karlsruhe Institute of Technology

  • Venue:
  • KI'10 Proceedings of the 33rd annual German conference on Advances in artificial intelligence
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Most approaches to the visual perception of humans do not include high-level activity recognitition. This paper presents a system that fuses and interprets the outputs of several computer vision components as well as speech recognition to obtain a high-level understanding of the perceived scene. Our laboratory for investigating new ways of human-machine interaction and teamwork support, is equipped with an assemblage of cameras, some close-talking microphones, and a videowall as main interaction device. Here, we develop state of the art real-time computer vision systems to track and identify users, and estimate their visual focus of attention and gesture activity. We also monitor the users' speech activity in real time. This paper explains our approach to highlevel activity recognition based on these perceptual components and a temporal logic engine.