A three-state model of graphical input
INTERACT '90 Proceedings of the IFIP TC13 Third Interational Conference on Human-Computer Interaction
Navigating documents with the virtual scroll ring
Proceedings of the 17th annual ACM symposium on User interface software and technology
Lucid touch: a see-through mobile device
Proceedings of the 20th annual ACM symposium on User interface software and technology
Rubbing and tapping for precise and rapid selection on touch-screen displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
TapTap and MagStick: improving one-handed target acquisition on small touch-screens
AVI '08 Proceedings of the working conference on Advanced visual interfaces
MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Characteristics of pressure-based input for mobile devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Z-touch: an infrastructure for 3d gesture interaction in the proximity of tabletop surfaces
ACM International Conference on Interactive Tabletops and Surfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
AnglePose: robust, precise capacitive touch tracking via 3d orientation estimation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
OmniTouch: wearable multitouch interaction everywhere
Proceedings of the 24th annual ACM symposium on User interface software and technology
ShoeSense: a new perspective on gestural interaction and wearable applications
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
PalmSpace: continuous around-device gestures vs. multitouch for 3D rotation tasks on mobile devices
Proceedings of the International Working Conference on Advanced Visual Interfaces
The fat thumb: using the thumb's contact size for single-handed mobile interaction
MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
GaussSense: attachable stylus sensing using magnetic sensor grid
Proceedings of the 25th annual ACM symposium on User interface software and technology
Making graphic-based authentication secure against smudge attacks
Proceedings of the 2013 international conference on Intelligent user interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
PointPose demo: using a depth camera for finger pose estimation on touch-based mobile devices
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Hi-index | 0.00 |
The expressiveness of touch input can be increased by detecting additional finger pose information at the point of touch such as finger rotation and tilt. PointPose is a prototype that performs finger pose estimation at the location of touch using a short-range depth sensor viewing the touch screen of a mobile device. We present an algorithm that extracts finger rotation and tilt from a point cloud generated by a depth sensor oriented towards the device's touchscreen. The results of two user studies we conducted show that finger pose information can be extracted reliably using our proposed method. We show this for controlling rotation and tilt axes separately and also for combined input tasks using both axes. With the exception of the depth sensor, which is mounted directly on the mobile device, our approach does not require complex external tracking hardware, and, furthermore, external computation is unnecessary as the finger pose extraction algorithm can run directly on the mobile device. This makes PointPose ideal for prototyping and developing novel mobile user interfaces that use finger pose estimation.