Visual contextualization and activity monitoring for networked telepresence

  • Authors:
  • Douglas A. Fidaleo;R. Evan Schumacher;Mohan M. Trivedi

  • Affiliations:
  • University of California San Diego, La Jolla, CA;University of California San Diego, La Jolla, CA;University of California San Diego, La Jolla, CA

  • Venue:
  • Proceedings of the 2004 ACM SIGMM workshop on Effective telepresence
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

The context of an environment is denied by a complex interrelationship between past, present, and future events and of the events' surroundings. While the present provides a current and immediate interpretation of our surroundings and enables immediate decisions, historical data enables post-mortem analysis of an incident as well as a foreshadowing of future events that can in turn afect the context upon which current decisions depend. Achieving context awareness therefore requires extraction, capture, and interpretation of multiple modes of information from different temporal and spatial contexts. Contextualization of this data involves embedding the information into a single familiar virtual environment to assist a human operator in making sense of the volumes of collected sensory data. This paper details a prototype system we are developing to facilitate future context awareness research as well as support, integrate, and augment existing context focused research developed in our laboratory. The core modules of the system are described including the Networked Sensor Tapestry (NeST) architecture for sensor integration, processing, and context archiving and querying with a focus on the Context Visualization Environment (CoVE): a 3D environment for visual fusion of multimodal sensor data. Several real-world applications are presented that are built on top of these components.