Juke cylinder: sound image augmentation to metamorphose hands into a musical instrument

  • Authors:

  • Masamichi Ueta;Osamu Hoshuyama;Takuji Narumi;Sho Sakurai;Tomohiro Tanikawa;Michitaka Hirose

  • Affiliations:

  • The University of Tokyo, Bunkyo-ku, Tokyo, Japan;NEC Corporation, Kawasaki, Kanagawa, Japan;The University of Tokyo, Bunkyo-ku, Tokyo, Japan;The University of Tokyo, Bunkyo-ku, Tokyo, Japan;The University of Tokyo, Bunkyo-ku, Tokyo, Japan;The University of Tokyo, Bunkyo-ku, Tokyo, Japan

  • Venue:
  • ACE'12 Proceedings of the 9th international conference on Advances in Computer Entertainment
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper proposes a piece of interactive art installation named the "Juke Cylinder" to augment sound images through hand interaction and to metamorphose hands into a musical instrument. To augment a sound image onto users' hands, we used a parametric loudspeaker because it can localize a sound image on a reflecting surface. When users interact with our system, they perceive that their hands are metamorphosed into various musical instruments such as a guitar, a piano, or a synthesizer. Users can control the pitches of the sounds depending on their hand interactions such as with real musical instruments. In a demonstration at a media art exhibition, this system provided visitors with extraordinary sound experiences, and we received positive feedback from them.