The sound of touch: on-body touch and gesture sensing based on transdermal ultrasound propagation

Authors:
Adiyan Mujibiya;Xiang Cao;Desney S. Tan;Dan Morris;Shwetak N. Patel;Jun Rekimoto
Affiliations:
The University of Tokyo, Tokyo, Japan;Microsoft Research, Beijing, China;Microsoft Research, Redmond, WA, USA;Microsoft Research, Redmond, WA, USA;University of Washington, Seattle, WA, USA;The University of Tokyo, Tokyo, Japan
Venue:
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Year:
2013

Citing 12
Cited 0

Applying electric field sensing to human-computer interfaces

CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Personal area networks: near-field intrabody communication

IBM Systems Journal
Enabling always-available input with muscle-computer interfaces

Proceedings of the 22nd annual ACM symposium on User interface software and technology
The WEKA data mining software: an update

ACM SIGKDD Explorations Newsletter
Skinput: appropriating the body as an input surface

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Your noise is my command: sensing gestures using the body as an antenna

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Active bone-conducted sound sensing for wearable interfaces

Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology
Pub - point upon body: exploring eyes-free interaction and methods on an arm

Proceedings of the 24th annual ACM symposium on User interface software and technology
SonarWatch: appropriating the forearm as a slider bar

SIGGRAPH Asia 2011 Emerging Technologies
Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Humantenna: using the body as an antenna for real-time whole-body interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using rhythmic patterns as an input method

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Recent work has shown that the body provides an interesting interaction platform. We propose a novel sensing technique based on transdermal low-frequency ultrasound propagation. This technique enables pressure-aware continuous touch sensing as well as arm-grasping hand gestures on the human body. We describe the phenomena we leverage as well as the system that produces ultrasound signals on one part of the body and measures this signal on another. The measured signal varies according to the measurement location, forming distinctive propagation profiles which are useful to infer on-body touch locations and on-body gestures. We also report on a series of experimental studies with 20 participants that characterize the signal, and show robust touch and gesture classification along the forearm.