Hyper-shaku (Border-Crossing): towards the multi-modal gesture-controlled hyper-instrument

  • Authors:
  • Kirsty Beilharz;Joanne Jakovich;Sam Ferguson

  • Affiliations:
  • University of Sydney;University of Sydney;University of Sydney

  • Venue:
  • NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

Hyper-shaku (Border-Crossing) is an interactive sensor environment that uses motion sensors to trigger immediate responses and generative processes augmenting the Japanese bamboo shakuhachi in both the auditory and visual domain. The latter differentiates this process from many hyper-instruments by building a performance of visual design as well as electronic music on top of the acoustic performance. It utilizes a combination of computer vision and wireless sensing technologies conflated from preceding works. This paper outlines the use of gesture in these preparatory sound and audio-visual performative, installation and sonification works, leading to a description of the Hyper-shaku environment integrating sonification and generative elements.