A Flexible New Technique for Camera Calibration
IEEE Transactions on Pattern Analysis and Machine Intelligence
A Wearable Computer Based American Sign Language Recognizer
ISWC '97 Proceedings of the 1st IEEE International Symposium on Wearable Computers
ISWC '99 Proceedings of the 3rd IEEE International Symposium on Wearable Computers
ISWC '00 Proceedings of the 4th IEEE International Symposium on Wearable Computers
Lightglove: Wrist-Worn Virtual Typing and Pointing
ISWC '01 Proceedings of the 5th IEEE International Symposium on Wearable Computers
GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices
ISWC '01 Proceedings of the 5th IEEE International Symposium on Wearable Computers
Seam carving for content-aware image resizing
ACM SIGGRAPH 2007 papers
Vision-based hand pose estimation: A review
Computer Vision and Image Understanding
The Gesture Watch: A Wireless Contact-free Gesture based Wrist Interface
ISWC '07 Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers
Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking
ISWC '07 Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers
Mouse 2.0: multi-touch meets the mouse
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Enabling always-available input with muscle-computer interfaces
Proceedings of the 22nd annual ACM symposium on User interface software and technology
On the choice and placement of wearable vision sensors
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
SixthSense: a wearable gestural interface
ACM SIGGRAPH ASIA 2009 Sketches
Skinput: appropriating the body as an input surface
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Imaginary interfaces: spatial interaction with empty hands and without visual feedback
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
ISWC '11 Proceedings of the 2011 15th Annual International Symposium on Wearable Computers
OmniTouch: wearable multitouch interaction everywhere
Proceedings of the 24th annual ACM symposium on User interface software and technology
6D hands: markerless hand-tracking for computer aided design
Proceedings of the 24th annual ACM symposium on User interface software and technology
KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera
Proceedings of the 24th annual ACM symposium on User interface software and technology
Touch interface on back of the hand
ACM SIGGRAPH 2011 Emerging Technologies
HoloDesk: direct 3d interactions with a situated see-through display
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ShoeSense: a new perspective on gestural interaction and wearable applications
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A Survey of Glove-Based Systems and Their Applications
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
ICCV '11 Proceedings of the 2011 International Conference on Computer Vision
Interactive environment-aware handheld projectors for pervasive computing spaces
Pervasive'12 Proceedings of the 10th international conference on Pervasive Computing
Image-based BRDF measurement including human skin
EGWR'99 Proceedings of the 10th Eurographics conference on Rendering
EyeRing: a finger-worn input device for seamless interactions with our surroundings
Proceedings of the 4th Augmented Human International Conference
Whole hand modeling using 8 wearable sensors: biomechanics for hand pose prediction
Proceedings of the 4th Augmented Human International Conference
Free-hands interaction in augmented reality
Proceedings of the 1st symposium on Spatial user interaction
Whole-home gesture recognition using wireless signals (demo)
Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM
Imaginary devices: gesture-based interaction mimicking traditional input devices
Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Whole-home gesture recognition using wireless signals
Proceedings of the 19th annual international conference on Mobile computing & networking
Sauron: embedded single-camera sensing of printed physical user interfaces
Proceedings of the 26th annual ACM symposium on User interface software and technology
uTrack: 3D input using two magnetic sensors
Proceedings of the 26th annual ACM symposium on User interface software and technology
Mime: compact, low power 3D gesture sensing for interaction with head mounted displays
Proceedings of the 26th annual ACM symposium on User interface software and technology
Sensor design and interaction techniques for gestural input to smart glasses and mobile devices
Proceedings of the adjunct publication of the 26th annual ACM symposium on User interface software and technology
Dynamics based 3D skeletal hand tracking
Proceedings of Graphics Interface 2013
Magic Ring: a self-contained gesture input device on finger
Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia
Free-hand interaction for handheld augmented reality using an RGB-depth camera
SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications
Hi-index | 0.00 |
Digits is a wrist-worn sensor that recovers the full 3D pose of the user's hand. This enables a variety of freehand interactions on the move. The system targets mobile settings, and is specifically designed to be low-power and easily reproducible using only off-the-shelf hardware. The electronics are self-contained on the user's wrist, but optically image the entirety of the user's hand. This data is processed using a new pipeline that robustly samples key parts of the hand, such as the tips and lower regions of each finger. These sparse samples are fed into new kinematic models that leverage the biomechanical constraints of the hand to recover the 3D pose of the user's hand. The proposed system works without the need for full instrumentation of the hand (for example using data gloves), additional sensors in the environment, or depth cameras which are currently prohibitive for mobile scenarios due to power and form-factor considerations. We demonstrate the utility of Digits for a variety of application scenarios, including 3D spatial interaction with mobile devices, eyes-free interaction on-the-move, and gaming. We conclude with a quantitative and qualitative evaluation of our system, and discussion of strengths, limitations and future work.