Depression analysis: a multimodal approach

  • Authors:
  • Jyoti Joshi

  • Affiliations:
  • University of Canberra, Canberra, Australia

  • Venue:
  • Proceedings of the 14th ACM international conference on Multimodal interaction
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Depression is a severe mental health disorder causing high societal costs. Current clinical practice depends almost exclusively on self report and clinical opinion, risking a range of subjective biases. It is therefore useful to design a diagnostic aid to assist clinicians. This project aims at developing a novel multimodal framework for depression analysis. In this PhD work, it is hypothesized that a multimodal affective sensing system can better capture what characterises a person's affective state than single modality systems. The project will explore facial dynamics, head movements, upper body gestures, EEG measures and speech characteristics related to affect, in subjects with major depressive disorders. Integrating the individual sensing modalities, a multimodal approach that show improved performance characteristics over single modality approaches will be developed.