Multimodal behavioral analysis for non-invasive stress detection

  • Authors:
  • Davide Carneiro;José Carlos Castillo;Paulo Novais;Antonio FernáNdez-Caballero;José Neves

  • Affiliations:
  • Universidade do Minho, Departamento de Informática, Campus of Gualtar, 4710-057 Braga, Portugal;Universidad de Castilla-La Mancha, Instituto de Investigación en Informática de Albacete, 02071 Albacete, Spain;Universidade do Minho, Departamento de Informática, Campus of Gualtar, 4710-057 Braga, Portugal;Universidad de Castilla-La Mancha, Instituto de Investigación en Informática de Albacete, 02071 Albacete, Spain;Universidade do Minho, Departamento de Informática, Campus of Gualtar, 4710-057 Braga, Portugal

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2012

Quantified Score

Hi-index 12.05

Visualization

Abstract

This study presents and approach to measure the levels of acute stress in humans by analysing their behavioral patterns when interacting with technological devices. We study the effects of stress on eight behavioral, physical and cognitive features. The data was collected with the participation of 19 users in different phases, with different levels of stress induced. A non-parametric statistical hypothesis test is used to determine which features show statistically significant differences, for each user, when under stress. It is shown that the features more related to stress are the acceleration and the mean and maximum intensity of the touch. It is also shown that each user is affected by stress in a specific way. Moreover, all the process of estimating stress is undertaken in a non-invasive way. This work constitutes the foundation of a context layer for a virtual environment for conflict resolution. The main objective is to overcome some of the main drawbacks of communicating online, namely the lack of contextual information such as body language or gestures.