Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System
IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
Open Scene Graph A: Introduction, B: Examples and Applications
VR '04 Proceedings of the IEEE Virtual Reality 2004
| Hi-index | 0.00 |
As part of the CALLAS project [1], our aim is to explore multimodal interaction in an Arts and Entertainment context. This creative showcase is an Augmented Reality Art installation, which reacts to user behaviour using multimodal analysis of affective signals. The installation features a virtual tree, whose growth is influenced by the perceived emotional response from the spectators. The system implements a 'magic mirror' paradigm (using a large-screen display or projection system) and produces interactive graphics based on the ARToolkit [2, 3] with extended representations for scene graphs [4]. The system relies on a PAD dimensional model [5] to support the fusion of affective modalities, each input modality being represented as a PAD vector. A further advantage of the PAD model is that it supports the representation of affective responses that relate to aesthetic impressions. The influence of affective input on the visual component is achieved by mapping affective data to an L-System governing virtual tree behaviour. We have performed an early evaluation of the system, both from the technical perspective and in terms of user experience.