Fusion of fragmentary classifier decisions for affective state recognition

  • Authors:
  • Gerald Krell;Michael Glodek;Axel Panning;Ingo Siegert;Bernd Michaelis;Andreas Wendemuth;Friedhelm Schwenker

  • Affiliations:
  • Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke University Magdeburg, Germany;Institute of Neural Information Processing, Ulm University, Germany;Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke University Magdeburg, Germany;Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke University Magdeburg, Germany;Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke University Magdeburg, Germany;Institute for Electronics, Signal Processing and Communications, Otto-von-Guericke University Magdeburg, Germany;Institute of Neural Information Processing, Ulm University, Germany

  • Venue:
  • MPRSS'12 Proceedings of the First international conference on Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Real human-computer interaction systems based on different modalities face the problem that not all information channels are always available at regular time steps. Nevertheless an estimation of the current user state is required at anytime to enable the system to interact instantaneously based on the available modalities. A novel approach to decision fusion of fragmentary classifications is therefore proposed and empirically evaluated for audio and video signals of a corpus of non-acted user behavior. It is shown that visual and prosodic analysis successfully complement each other leading to an outstanding performance of the fusion architecture.