AnglePose: robust, precise capacitive touch tracking via 3d orientation estimation

Authors:
Simon Rogers;John Williamson;Craig Stewart;Roderick Murray-Smith
Affiliations:
University of Glasgow, Glasgow, United Kingdom;University of Glasgow, Glasgow, United Kingdom;University of Glasgow, Glasgow, United Kingdom;University of Glasgow, Glasgow, United Kingdom
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2011

Citing 16
Cited 13

Contour Tracking by Stochastic Propagation of Conditional Density

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
PreSense: interaction techniques for finger sensing input devices

Proceedings of the 16th annual ACM symposium on User interface software and technology
Hover widgets: using the tracking state to extend the capabilities of pen-operated devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Precise selection techniques for multi-touch screens

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
iSith - Intersection-based Spatial Interaction for Two Hands

3DUI '06 Proceedings of the 3D User Interfaces
Target size study for one-handed thumb use on small touchscreen devices

Proceedings of the 8th conference on Human-computer interaction with mobile devices and services
TapTap and MagStick: improving one-handed target acquisition on small touch-screens

AVI '08 Proceedings of the working conference on Advanced visual interfaces
MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An evaluation of one-handed techniques for multiple-target selection

CHI '09 Extended Abstracts on Human Factors in Computing Systems
Separability of spatial manipulations in multi-touch interfaces

Proceedings of Graphics Interface 2009
Detecting and leveraging finger orientation for interaction with direct-touch surfaces

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices

Proceedings of the 22nd annual ACM symposium on User interface software and technology
Occlusion-aware interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
FingerCloud: uncertainty and autonomy handover incapacitive sensing

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The generalized perceived input point model and how to double touch accuracy by extracting fingerprints

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
In-air typing interface for mobile devices with vibration feedback

ACM SIGGRAPH 2010 Emerging Technologies

KinectTouch: accuracy test for a very low-cost 2.5D multitouch tracking system

Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
The fat thumb: using the thumb's contact size for single-handed mobile interaction

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
GaussSense: attachable stylus sensing using magnetic sensor grid

Proceedings of the 25th annual ACM symposium on User interface software and technology
A user-specific machine learning approach for improving touch accuracy on mobile devices

Proceedings of the 25th annual ACM symposium on User interface software and technology
Machine learning models for uncertain interaction

Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology
Tickle: a surface-independent interaction technique for grasp interfaces

Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction
Focused and casual interactions: allowing users to vary their level of engagement

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User-specific touch models in a cross-device context

Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Sparse selection of training data for touch correction systems

Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
PointPose: finger pose estimation for touch input on mobile devices using a depth sensor

Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
PointPose demo: using a depth camera for finger pose estimation on touch-based mobile devices

Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Improving accuracy in back-of-device multitouch typing: a clustering-based approach to keyboard updating

Proceedings of the 19th international conference on Intelligent User Interfaces
Touch tracking with a particle filter

Machine Vision and Applications

Quantified Score

Hi-index	0.01

Visualization

Abstract

We present a finger-tracking system for touch-based interaction which can track 3D finger angle in addition to position, using low-resolution conventional capacitive sensors, therefore compensating for the inaccuracy due to pose variation in conventional touch systems. Probabilistic inference about the pose of the finger is carried out in real-time using a particle filter; this results in an efficient and robust pose estimator which also gives appropriate uncertainty estimates. We show empirically that tracking the full pose of the finger results in greater accuracy in pointing tasks with small targets than competitive techniques. Our model can detect and cope with different finger sizes and the use of either fingers or thumbs, bringing a significant potential for improvement in one-handed interaction with touch devices. In addition to the gain in accuracy we also give examples of how this technique could open up the space of novel interactions.