SCAAT: incremental tracking with incomplete information
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
Estimation with Applications to Tracking and Navigation
Estimation with Applications to Tracking and Navigation
TouchLight: an imaging touch screen and display for gesture-based interaction
Proceedings of the 6th international conference on Multimodal interfaces
Low-cost multi-touch sensing through frustrated total internal reflection
Proceedings of the 18th annual ACM symposium on User interface software and technology
A Generic Camera Model and Calibration Method for Conventional, Wide-Angle, and Fish-Eye Lenses
IEEE Transactions on Pattern Analysis and Machine Intelligence
Seam carving for content-aware image resizing
ACM SIGGRAPH 2007 papers
Single user multitouch on the DiamondTouch: from 2 x 1D to 2D
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Inverted FTIR: easy multitouch sensing for flatscreens
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
A Survey on the Development of Multi-touch Technology
APWCS '10 Proceedings of the 2010 Asia-Pacific Conference on Wearable Computing Systems
| Hi-index | 0.00 |
We applied a computer vision based method and developed multi-touch technology to be adopted in various display types. In the selected design, multiple cameras are placed on the side of the display with their optical axis parallel to the screen. The display edges opposite the cameras are illuminated and fingers are detected since they block the light in the camera images. The approach is scalable and can be used in a wide variety of displays. Due to self-occlusion of the touchpoints, it is challenging to relate camera measurements to tracked points. In this paper, we present our approach for tracking and managing multiple touchpoints in such camera set-ups. We describe the mathematical background for modeling and calibrating the cameras, the design of the extended Kalman filter for point tracking, and the logic for adding, updating and removing the touchpoints. We analyze the potential accuracy and robustness of the system using several simulations and present two different real-life implementations of the approach.