Realsound interaction: a novel interaction method with mixed reality space by localizing sound events in real world

Authors:
Mai Otsuki;Asako Kimura;Takanobu Nishiura;Fumihisa Shibata;Hideyuki Tamura
Affiliations:
Graduate School of Science and Engineering, Ritsumeikan University, Shiga, Japan;Graduate School of Science and Engineering, Ritsumeikan University, Shiga, Japan;Graduate School of Science and Engineering, Ritsumeikan University, Shiga, Japan;Graduate School of Science and Engineering, Ritsumeikan University, Shiga, Japan;Graduate School of Science and Engineering, Ritsumeikan University, Shiga, Japan
Venue:
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction platforms and techniques
Year:
2007

Citing 4
Cited 0

The migratory cursor: accurate speech-based cursor movement by moving multiple ghost cursors using non-verbal vocalizations

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Spatial ontology for semantic integration in 3D multimodal interaction framework

Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications
Localization of multiple sound sources based on a CSP analysis with a microphone array

ICASSP '00 Proceedings of the Acoustics, Speech, and Signal Processing, 2000. on IEEE International Conference - Volume 02
Estimation of source location based on 2-D MUSIC and its application to speech recognition in cars

ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 05

Quantified Score

Hi-index	0.00

Visualization

Abstract

We developed a mixed reality (MR) system which merges the real and the virtual worlds in both audio and visual senses. Our new approach "RealSound Interaction" is based on the idea that the sound events in the real world can work as interaction devices with an MR space. Firstly, we developed a sound detection system which localizes a sound source. The system consisted of two types of microphone arrays, fixed type and wearable type. Secondly, we evaluated the accuracy of the system, and proposed three practical usages of the sound events as interactive devices for MR attractions.