Interactive experience retrieval for a ubiquitous home

  • Authors:
  • Gamhewage C. de Silva;Toshihiko Yamasaki;Kiyoharu Aizawa

  • Affiliations:
  • The University of Tokyo;The University of Tokyo;The University of Tokyo

  • Venue:
  • Proceedings of the 3rd ACM workshop on Continuous archival and retrival of personal experences
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present the current status of a system for continuous capture and retrieval of multimedia data from a home-like ubiquitous environment. A large number of cameras and microphones are used for video and audio acquisition. Pressure based sensors mounted on the house floor capture footsteps. The image and floor sensor data are analyzed further to add more functionality to a previously developed system. Basic image analysis is combined with interactive rank selection to identify significant events. A preliminary study is conducted on activity classification based on floor sensor data and we present the results. The system can be queried interactively based on date and time, location, persons, sounds and basic activity in terms of footsteps. After a brief discussion of the results and observations, the paper concludes with suggestions for possible future directions.