Towards a Multimodal Framework for Human Behavior Recognition

  • Authors:
  • Sidi O. Soueina;Jocelyne Kiss;Pascal Chaudeyrac;Patrice Bouvier;Ahmed H. Salem;Adel S. Elmaghraby

  • Affiliations:
  • Sullivan University, USA;LISAA University Marne la Valley, France;University Marne la Valley, France;University Marne la Valley, France;Hood College, USA;University of Louisville, USA

  • Venue:
  • WI-IATW '06 Proceedings of the 2006 IEEE/WIC/ACM international conference on Web Intelligence and Intelligent Agent Technology
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a framework of an interface that is capable of detecting and classifying human intentions and personality types. The framework relies on a conventional set of multimodal components, namely an eye-tracking system, a mouse and a keyboard, where a large number of real time data analysis will take place, in order to detect behavioral patterns. The system gradually learns from the players and builds a collection of patterns of actions. The personalities of the players are detected through ontological comparisons of known personality types with the newly discovered patterns of actions. We further layout the ground of our initial assumption -- appearing in other publications, that the sub-conscious controls the eyes movements during the game, on those elements or words that are related to the fears and desire, i.e., the personality of the player.