Realtime audiovisual rendering and contemporary audiovisual art

Authors:
Tapio Lokki;Jarmo Hiipakka;Rami Hänninen;Tommi Ilmonen;Lauri Savioja;Tapio Takala
Affiliations:
Helsinki University of Technology, Telecommunication Software and Multimedia Laboratory, PO Box 5400, FIN-02015 HUT, Finland Tapio.Lokki@hut.fi http://www.tcm.hut.fi/Research/DIVA;Helsinki University of Technology, Telecommunication Software and Multimedia Laboratory, PO Box 5400, FIN-02015 HUT, Finland;Helsinki University of Technology, Telecommunication Software and Multimedia Laboratory, PO Box 5400, FIN-02015 HUT, Finland;Helsinki University of Technology, Telecommunication Software and Multimedia Laboratory, PO Box 5400, FIN-02015 HUT, Finland;Helsinki University of Technology, Telecommunication Software and Multimedia Laboratory, PO Box 5400, FIN-02015 HUT, Finland;Helsinki University of Technology, Telecommunication Software and Multimedia Laboratory, PO Box 5400, FIN-02015 HUT, Finland
Venue:
Organised Sound
Year:
1998

Citing 9
Cited 5

Computer graphics: principles and practice (2nd ed.)

Computer graphics: principles and practice (2nd ed.)
About the Cover

Computer - Special issue: Computer-generated music
Sound rendering

SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
3-D sound for virtual reality and multimedia

3-D sound for virtual reality and multimedia
Neural networks: a systematic introduction

Neural networks: a systematic introduction
Improv: a system for scripting interactive actors in virtual worlds

SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Principles of Digital Image Synthesis

Principles of Digital Image Synthesis
Factors influencing operator interaction with virtual objects viewed via head-mounted see-through displays: viewing conditions and rendering latency

VRAIS '97 Proceedings of the 1997 Virtual Reality Annual International Symposium (VRAIS '97)
Virtual musical instruments — natural sound using physical models

Organised Sound

Creating Interactive Virtual Auditory Environments

IEEE Computer Graphics and Applications
Implementation of a 3D virtual drummer

Proceedings of the Eurographic workshop on Computer animation and simulation
A Fuzzy-Logic Mapper for Audiovisual Media

Computer Music Journal
Interactive sound rendering

ACM SIGGRAPH 2009 Courses
Sound-power visualization system for real-world interaction based on ultrasonic power transmission

Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

Visual rendering is the process of creating synthetic images of digital models. The modelling of sound synthesis and propagation in a virtual space is called sound rendering. In this article we review different audiovisual rendering techniques suitable for realtime rendering of three-dimensional virtual worlds. Virtual environments are useful in various application areas, for example in architectural visualisation. With audiovisual rendering, lighting and acoustics of a modelled concert hall can be experienced early in the design stage of the building. In this article we demonstrate an interactive audiovisual rendering system where an animated virtual orchestra plays in a modelled concert hall. Virtual musicians are conducted by a real conductor who wears a wired data dress suit and a baton. The conductor and the audience hear the music rendered according to the acoustics of the virtual concert hall, creating a lifelike experience.