MusiKalscope: A Graphical Musical Instrument
IEEE MultiMedia
In-situ speech visualization in real-time interactive installation and performance
Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering
New Digital Musical Instruments: Control And Interaction Beyond the Keyboard (Computer Music and Digital Audio Series)
The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces
Proceedings of the 1st international conference on Tangible and embedded interaction
Bateau ivre: an artistic markerless outdoor mobile augmented reality installation on a riverboat
Proceedings of the international conference on Multimedia
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
Hi-index | 0.00 |
The Organ and Augmented Reality (ORA) project has been presented to public audiences at two immersive concerts, with both visual and audio augmentations of an historic church organ. On the visual side, the organ pipes displayed a spectral analysis of the music using visuals inspired by LED-bar VU-meters. On the audio side, the audience was immersed in a periphonic sound field, acoustically placing listeners inside the instrument. The architecture of the graphical side of the installation is made of acoustic analysis and calibration, mapping from sound levels to animation, visual calibration, real-time multi-layer graphical composition and animation. It opens new perspectives to musical instrument augmentation where the purpose is to make the instrument more legible while offering the audience enhanced artistic content.