A 3-D immersive synthesizer for environmental sounds

  • Authors:
  • Charles Verrron;Mitsuko Aramaki;Richard Kronland-Martinet;Grégory Pallone

  • Affiliations:
  • Department of Audiovisual and Speech for Quality, Orange Labs, Lannion, France and CNRS, Laboratoire de Mécanique et d' Acoustique, Marseille, France;CNRS, Institut de Neurosciences Cognitives de la Méditerranée, Marseille, France;CNRS, LMA, Marseille, France;Department of Audiovisual and Speech for Quality, Orange Labs, Lannion, France

  • Venue:
  • IEEE Transactions on Audio, Speech, and Language Processing
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Nowadays, interactive 3-D environments tend to include both synthesis and spatialization processes to increase the realism of virtual scenes. In typical systems, audio generation is created in two stages: first, a monophonic sound is synthesized (generation of the intrinsic timbre properties) and then it is spatialized (positioned in its environment). In this paper, we present the design of a 3-D immersive synthesizer dedicated to environmental sounds, and intended to be used in the framework of interactive virtual reality applications. The system is based on a physical categorization of environmental sounds (vibrating solids, liquids, aerodynamics). The synthesis engine has a novel architecture combining an additive synthesis model and 3-D audio modules at the prime level of sound generation. An original approach exploiting the synthesis capabilities for simulating the spatial extension of sound sources is also presented. The subjective results, evaluated with a formal listening test, are discussed. Finally, new control strategies based on a global manipulation of timbre and spatial attributes of sound sources are introduced.