The design and analysis of spatial data structures
The design and analysis of spatial data structures
View interpolation for image synthesis
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Three-dimensional computer vision: a geometric viewpoint
Three-dimensional computer vision: a geometric viewpoint
Independent component analysis, a new concept?
Signal Processing - Special issue on higher order statistics
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
SIGGRAPH '96 Proceedings of the 23rd annual conference on Computer graphics and interactive techniques
Tour into the picture: using a spidery mesh interface to make animation from a single image
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Microphone arrays for video camera steering
Acoustic signal processing for telecommunication
Unstructured lumigraph rendering
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Plenoptic stitching: a scalable method for reconstructing 3D interactive walk throughs
Proceedings of the 28th annual conference on Computer graphics and interactive techniques
SIGGRAPH '84 Proceedings of the 11th annual conference on Computer graphics and interactive techniques
Perceptual audio rendering of complex virtual environments
ACM SIGGRAPH 2004 Papers
Learning Overcomplete Representations
Neural Computation
New direct approaches to robust sound source localization
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
ICASSP '96 Proceedings of the Acoustics, Speech, and Signal Processing, 1996. on Conference Proceedings., 1996 IEEE International Conference - Volume 02
Blind separation of disjoint orthogonal signals: demixing N sources from 2 mixtures
ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 05
The fusion of distributed microphone arrays for sound localization
EURASIP Journal on Applied Signal Processing
Blind source separation combining independent component analysis and beamforming
EURASIP Journal on Applied Signal Processing
Performance of GCC-and AMDF-based time-delay estimation in practical reverberant environments
EURASIP Journal on Applied Signal Processing
Time delay estimation in room acoustic environments: an overview
EURASIP Journal on Applied Signal Processing
Multiple acoustic sources location based on blind source separation
ICNC'05 Proceedings of the First international conference on Advances in Natural Computation - Volume Part I
Blind separation of speech mixtures via time-frequency masking
IEEE Transactions on Signal Processing
Learning a Precedence Effect-Like Weighting Function for the Generalized Cross-Correlation Framework
IEEE Transactions on Audio, Speech, and Language Processing
Blind Extraction of Dominant Target Sources Using ICA and Time-Frequency Masking
IEEE Transactions on Audio, Speech, and Language Processing
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Acoustic Rendering and Auditory–Visual Cross-Modal Perception and Interaction
Computer Graphics Forum
| Hi-index | 0.00 |
We present a novel approach to real-time spatial rendering of realistic auditory environments and sound sources recorded live, in the field. Using a set of standard microphones distributed throughout a real-world environment, we record the sound field simultaneously from several locations. After spatial calibration, we segment from this set of recordings a number of auditory components, together with their location. We compare existing time delay of arrival estimation techniques between pairs of widely spaced microphones and introduce a novel efficient hierarchical localization algorithm. Using the high-level representation thus obtained, we can edit and rerender the acquired auditory scene over a variety of listening setups. In particular, we can move or alter the different sound sources and arbitrarily choose the listening position. We can also composite elements of different scenes together in a spatially consistent way. Our approach provides efficient rendering of complex soundscapes which would be challenging to model using discrete point sources and traditional virtual acoustics techniques. We demonstrate a wide range of possible applications for games, virtual and augmented reality, and audio visual post production.