Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns
IEEE Transactions on Pattern Analysis and Machine Intelligence
Sweep and point and shoot: phonecam-based interactions for large public displays
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Distant freehand pointing and clicking on very large, high resolution displays
Proceedings of the 18th annual ACM symposium on User interface software and technology
Direct pointer: direct manipulation for large-display interaction using handheld cameras
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tracking of deformable human hand in real time as continuous input for gesture-based interaction
Proceedings of the 12th international conference on Intelligent user interfaces
A Moving Objects Detection Algorithm Based on Improved Background Subtraction
ISDA '08 Proceedings of the 2008 Eighth International Conference on Intelligent Systems Design and Applications - Volume 03
WUW - wear Ur world: a wearable gestural interface
CHI '09 Extended Abstracts on Human Factors in Computing Systems
ARC-Pad: absolute+relative cursor positioning for large displays with a mobile touchscreen
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Motion-path based gesture interaction with smart home services
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Toward natural interaction in the real world: real-time gesture recognition
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Vision-based hand-gesture applications
Communications of the ACM
Single camera pointing gesture recognition for interaction in edutainment applications
Proceedings of the 24th Spring Conference on Computer Graphics
A boosted classifier tree for hand shape detection
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
| Hi-index | 0.00 |
Smart phones and external large displays are a superior combination for content sharing and multiple person interaction. However, the potential of such a combination is not fully explored due to the lack of effective and portable interaction solutions. To solve this problem, we present a novel mobile solution called Plug&Touch, which is very easy to be set up and enables mobile users to directly and naturally operate on the large display surface. Plug&Touch utilizes vision-based methods to detect the user's finger tip and then control user interface. The Local Binary Pattern asymmetric texture difference is proposed to extract the foreground region, and the coarse-to-fine intersection process is adopted to precisely localize the finger tip. Plug&Touch has been implemented on the Symbian3 platform with two defined gestures - click and scroll. Experimental results and user evaluation has shown the practicability of Plug&Touch.