Brightshadow: shadow sensing with synchronous illuminations for robust gesture recognition

Authors:
Jun Rekimoto
Affiliations:
The University of Tokyo / Sony CSL, Tokyo, Japan
Venue:
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Year:
2008

Citing 4
Cited 0

HoloWall: designing a finger, hand, body, and object sensitive wall

Proceedings of the 10th annual ACM symposium on User interface software and technology
Smart laser-scanner for 3D human-machine interface

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Low-cost multi-touch sensing through frustrated total internal reflection

Proceedings of the 18th annual ACM symposium on User interface software and technology
ThinSight: versatile multi-touch sensing for thin form-factor displays

Proceedings of the 20th annual ACM symposium on User interface software and technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

We introduce a new sensor architecture for robust gesture recognition that uses a combination of a high-speed camera and synchronous LED illumination. This sensor looks at shadows cast by a user's hand for recognizing position. The position of the hand can be robustly recognized by independently tracking multiple shadows and by using multiple light sources with time-synchronous modulation with the camera. We also developed a multi-finger tracking system that uses similar modulated illumination from multiple light positions. We expect that these sensing configurations can be naturally integrated into our daily environments as LED lighting becomes more commonplace.