Context-based scene recognition from visual data in smart homes: an Information Fusion approach

  • Authors:

  • Juan Gómez-Romero;Miguel A. Serrano;Miguel A. Patricio;Jesús García;José M. Molina

  • Affiliations:

  • University Carlos III of Madrid, Colmenarejo, Madrid, Spain 28270;University Carlos III of Madrid, Colmenarejo, Madrid, Spain 28270;University Carlos III of Madrid, Colmenarejo, Madrid, Spain 28270;University Carlos III of Madrid, Colmenarejo, Madrid, Spain 28270;University Carlos III of Madrid, Colmenarejo, Madrid, Spain 28270

  • Venue:
  • Personal and Ubiquitous Computing
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Ambient Intelligence (AmI) aims at the development of computational systems that process data acquired by sensors embedded in the environment to support users in everyday tasks. Visual sensors, however, have been scarcely used in this kind of applications, even though they provide very valuable information about scene objects: position, speed, color, texture, etc. In this paper, we propose a cognitive framework for the implementation of AmI applications based on visual sensor networks. The framework, inspired by the Information Fusion paradigm, combines a priori context knowledge represented with ontologies with real time single camera data to support logic-based high-level local interpretation of the current situation. In addition, the system is able to automatically generate feedback recommendations to adjust data acquisition procedures. Information about recognized situations is eventually collected by a central node to obtain an overall description of the scene and consequently trigger AmI services. We show the extensible and adaptable nature of the approach with a prototype system in a smart home scenario.