Experiencing real 3D gestural interaction with mobile devices

Authors:
Shahrouz Yousefi;Farid Abedan Kondori;Haibo Li
Affiliations:
Digital Media Lab, Department of Applied Physics and Electronics, Umeå University, 90187 Umeå, Sweden;Digital Media Lab, Department of Applied Physics and Electronics, Umeå University, 90187 Umeå, Sweden;Digital Media Lab, Department of Applied Physics and Electronics, Umeå University, 90187 Umeå, Sweden
Venue:
Pattern Recognition Letters
Year:
2013

Citing 19
Cited 0

Tracking of Multi-state Hand Models Using Particle Filtering and a Hierarchy of Multi-scale Image Features

Scale-Space '01 Proceedings of the Third International Conference on Scale-Space and Morphology in Computer Vision
Hand Gesture Recognition using Multi-Scale Colour Features, Hierarchical Models and Particle Filtering

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Finger Tracking for Interaction in Augmented Environments

ISAR '01 Proceedings of the IEEE and ACM International Symposium on Augmented Reality (ISAR'01)
Bare-hand human-computer interaction

Proceedings of the 2001 workshop on Perceptive user interfaces
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Fast 2D Hand Tracking with Flocks of Features and Multi-Cue Integration

CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 10 - Volume 10
Gesture Recognition using Hidden Markov Models from Fragmented Observations

CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1
Model-Based Hand Tracking Using a Hierarchical Bayesian Filter

IEEE Transactions on Pattern Analysis and Machine Intelligence
Heat sensation in image creation with thermal vision

Proceedings of the 2005 ACM SIGCHI International Conference on Advances in computer entertainment technology
A projection method to generate anaglyph stereo images

ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 2001. on IEEE International Conference - Volume 03
Vision-based hand pose estimation: A review

Computer Vision and Image Understanding
Shape recognition and pose estimation for mobile augmented reality

ISMAR '09 Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality
A color-based face tracking algorithm for enhancing interaction with mobile devices

The Visual Computer: International Journal of Computer Graphics - Special Issue on Cypberworlds'2009
Online gesture recognition for user interface on accelerometer built-in mobile phones

ICONIP'10 Proceedings of the 17th international conference on Neural information processing: models and applications - Volume Part II
Using mobile phones to write in air

MobiSys '11 Proceedings of the 9th international conference on Mobile systems, applications, and services
An empirical evaluation of virtual hand techniques for 3D object manipulation in a tangible augmented reality environment

3DUI '10 Proceedings of the 2010 IEEE Symposium on 3D User Interfaces
Markerless visual fingertip detection for natural mobile device interaction

Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
SURF: speeded up robust features

ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Vision-based remote control system by motion detection and open finger counting

IEEE Transactions on Consumer Electronics

Quantified Score

Hi-index	0.10

Visualization

Abstract

Number of mobile devices such as smart phones or Tablet PCs has been dramatically increased over the recent years. New mobile devices are equipped with integrated cameras and large displays which make the interaction with the device more efficient. Although most of the previous works on interaction between humans and mobile devices are based on 2D touch-screen displays, camera-based interaction opens a new way to manipulate in 3D space behind the device, in the camera's field of view. In this paper, our gestural interaction heavily relies on particular patterns from local orientation of the image called Rotational Symmetries. This approach is based on finding the most suitable pattern from a large set of rotational symmetries of different orders that ensures a reliable detector for hand gesture. Consequently, gesture detection and tracking can be hired as an efficient tool for 3D manipulation in various applications in computer vision and augmented reality. The final output will be rendered into color anaglyphs for 3D visualization. Depending on the coding technology, different low cost 3D glasses can be used for the viewers.