Unsupervised inference of auditory attention from biosensors

  • Authors:
  • Melih Kandemir;Arto Klami;Akos Vetek;Samuel Kaski

  • Affiliations:
  • Helsinki Institute for Information Technology HIIT, Department of Information and Computer Science, Aalto University, Finland;Helsinki Institute for Information Technology HIIT, Department of Information and Computer Science, Aalto University, Finland;Media Technologies Lab, Nokia Research Center, Finland;Helsinki Institute for Information Technology HIIT, Department of Information and Computer Science, Aalto University, Finland, Helsinki Institute for Information Technology HIIT, Department of Com ...

  • Venue:
  • ECML PKDD'12 Proceedings of the 2012 European conference on Machine Learning and Knowledge Discovery in Databases - Volume Part II
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We study ways of automatically inferring the level of attention a user is paying to auditory content, with applications for example in automatic podcast highlighting and auto-pause, as well as in a selection mechanism in auditory interfaces. In particular, we demonstrate how the level of attention can be inferred in an unsupervised fashion, without requiring any labeled training data. The approach is based on measuring the (generalized) correlation or synchrony between the auditory content and physiological signals reflecting the state of the user. We hypothesize that the synchrony is higher when the user is paying attention to the content, and show empirically that the level of attention can indeed be inferred based on the correlation. In particular, we demonstrate that the novel method of time-varying Bayesian canonical correlation analysis gives unsupervised prediction accuracy comparable to having trained a supervised Gaussian process regression with labeled training data recorded from other users.