Object-based activity recognition with heterogeneous sensors on wrist

  • Authors:

  • Takuya Maekawa;Yutaka Yanagisawa;Yasue Kishino;Katsuhiko Ishiguro;Koji Kamei;Yasushi Sakurai;Takeshi Okadome

  • Affiliations:

  • NTT Communication Science Laboratories, Kyoto, Japan;NTT Communication Science Laboratories, Kyoto, Japan;NTT Communication Science Laboratories, Kyoto, Japan;NTT Communication Science Laboratories, Kyoto, Japan;NTT Communication Science Laboratories, Kyoto, Japan;NTT Communication Science Laboratories, Kyoto, Japan;NTT Communication Science Laboratories, Kyoto, Japan

  • Venue:
  • Pervasive'10 Proceedings of the 8th international conference on Pervasive Computing
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper describes how we recognize activities of daily living (ADLs) with our designed sensor device, which is equipped with heterogeneous sensors such as a camera, a microphone, and an accelerometer and attached to a user's wrist. Specifically, capturing a space around the user's hand by employing the camera on the wrist mounted device enables us to recognize ADLs that involve the manual use of objects such as making tea or coffee and watering plant. Existing wearable sensor devices equipped only with a microphone and an accelerometer cannot recognize these ADLs without object embedded sensors. We also propose an ADL recognition method that takes privacy issues into account because the camera and microphone can capture aspects of a user's private life. We confirmed experimentally that the incorporation of a camera could significantly improve the accuracy of ADL recognition.