Electronic music: new ways to play
IEEE Spectrum
An HMM-Based Threshold Model Approach for Gesture Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Expected, sensed, and desired: A framework for designing sensing-based interaction
ACM Transactions on Computer-Human Interaction (TOCHI)
Empirical evaluation for finger input properties in multi-touch interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tilt techniques: investigating the dexterity of wrist-based input
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Characteristics of pressure-based input for mobile devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Dips and ceilings: understanding and supporting transitions to expertise in user interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multidimensional gesture sensing at the piano keyboard
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Continuous realtime gesture following and recognition
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Natural use profiles for the pen: an empirical exploration of pressure, tilt, and azimuth
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A-coord input: coordinating auxiliary input streams for augmenting contextual pen-based interactions
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using shear as a supplemental two-dimensional input channel for rich touchscreen interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
| Hi-index | 0.01 |
This paper addresses the question of how to extend the capabilities of a well-established interface in a way that respects users' existing expertise. The piano-style keyboard is among the most widely used and versatile of digital musical interfaces. However, it lacks the ability to alter the pitch of a note after it has been played, a limitation which prevents the performer from executing common expressive techniques including vibrato and pitch bending. We present a system for controlling pitch from the keyboard surface using capacitive touch sensors to measure the locations of the player's fingers on the keys. The large community of trained pianists makes the keyboard a compelling target for augmentation, but it also poses a challenge: how can a musical interface be extended while making use of the existing techniques performers have spent thousands of hours learning? In this paper, user studies with conservatory pianists explore the constraints of traditional keyboard technique and evaluate the usability of the continuous pitch control system. The paper also discusses implications for the extension of other established interfaces in musical and non-musical contexts.