Transmodal feedback as a new perspective for audio-visual effects

Authors:
Christian Jacquemin;Serge de Laubier
Affiliations:
LIMSI, ORSAY, France;Puce Muse, Wissous, France
Venue:
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Year:
2006

Citing 6
Cited 1

Using sonification

Multimedia Systems - Special issue on audio and multimedia
In-situ speech visualization in real-time interactive installation and performance

Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering
Sonigraphical instruments: from FMOL to the reacTable

NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
ACROE - ICA: artistic creation and computer interactive multisensory simulation force feedback gesture transducers

NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
Dynamic Independent Mapping Layers for Concurrent Control of Audio and Video Synthesis

Computer Music Journal
FlowField: investigating the semantics of caress

ACM SIGGRAPH 2002 conference abstracts and applications

Context aware, multimodal, and semantic rendering engine

Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry

Quantified Score

Hi-index	0.00

Visualization

Abstract

A new type of feedback is presented that involves both the auditory and visual modalities. It combines an audio resonant bandpass filter, a geometrically constructed mass-spring system and its graphical skin. The system shows a resonant behavior that is detailed in various parameter setups. Complex mass-spring topologies result in a coherent self-sustained audio-visual system that mimics gusts of wind blowing a veil and associated sound effects.