Face-to-Face Social Activity Detection Using Data Collected with a Wearable Device

  • Authors:
  • Pierluigi Casale;Oriol Pujol;Petia Radeva

  • Affiliations:
  • Computer Vision Center, Campus UAB, Edifici O, Bellaterra, Spain and Dep. of Applied Mathematics and Analysis, University of Barcelona, Spain;Computer Vision Center, Campus UAB, Edifici O, Bellaterra, Spain and Dep. of Applied Mathematics and Analysis, University of Barcelona, Spain;Computer Vision Center, Campus UAB, Edifici O, Bellaterra, Spain and Dep. of Applied Mathematics and Analysis, University of Barcelona, Spain

  • Venue:
  • IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this work the feasibility of building a socially aware badge that learns from user activities is explored. A wearable multisensor device has been prototyped for collecting data about user movements and photos of the environment where the user acts. Using motion data, speaking and other activities have been classified. Images have been analysed in order to complement motion data and help for the detection of social behaviours. A face detector and an activity classifier are both used for detecting if users have a social activity in the time they worn the device. Good results encourage the improvement of the system at both hardware and software level.