Vision-based motion estimation for interaction with mobile devices

Authors:
Jari Hannuksela;Pekka Sangi;Janne Heikkilä
Affiliations:
Machine Vision Group, Infotech Oulu and Department of Electrical and Information Engineering, University of Oulu, P.O. Box 4500, FIN 90014, Finland;Machine Vision Group, Infotech Oulu and Department of Electrical and Information Engineering, University of Oulu, P.O. Box 4500, FIN 90014, Finland;Machine Vision Group, Infotech Oulu and Department of Electrical and Information Engineering, University of Oulu, P.O. Box 4500, FIN 90014, Finland
Venue:
Computer Vision and Image Understanding
Year:
2007

Citing 9
Cited 8

The robust estimation of multiple motions: parametric and piecewise-smooth flow fields

Computer Vision and Image Understanding
Sensing techniques for mobile interaction

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
Handbook of Computer Vision and Applications with Cdrom

Handbook of Computer Vision and Applications with Cdrom
Direct Model-Based Image Motion Segmentation for Dynamic Scene Analysis

ACCV '95 Invited Session Papers from the Second Asian Conference on Computer Vision: Recent Developments in Computer Vision
Scale & Affine Invariant Interest Point Detectors

International Journal of Computer Vision
Motion Analysis Using Frame Differences with Spatial Gradient Measures

ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4 - Volume 04
Real-world interaction with camera phones

UCS'04 Proceedings of the Second international conference on Ubiquitous Computing Systems
A computational vision approach to image registration

IEEE Transactions on Image Processing

Superpipelined high-performance optical-flow computation architecture

Computer Vision and Image Understanding
Hybrid tracking and visual search

MM '08 Proceedings of the 16th ACM international conference on Multimedia
Doodle space: painting on a public display by cam-phone

AMC '09 Proceedings of the 2009 workshop on Ambient media computing
Adaptive motion-based gesture recognition interface for mobile phones

ICVS'08 Proceedings of the 6th international conference on Computer vision systems
Evaluation of motion-based interaction for mobile devices: A case study on image browsing

Interacting with Computers
iRotate: automatic screen rotation based on face orientation

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Interactive multi-frame reconstruction for mobile devices

Multimedia Tools and Applications
A low-cost 3D human interface device using GPU-based optical flow algorithms

Integrated Computer-Aided Engineering

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper introduces a novel interaction technique for handheld mobile devices which enables the user interface to be controlled by the motion of the user's hand. A feature-based approach is proposed for global motion estimation that exploits gradient measures for both feature selection and feature motion uncertainty analysis. A voting-based scheme is presented for outlier removal. A Kalman filter is applied for smoothing motion trajectories. A fixed-point implementation of the method was developed due to the lack of floating-point hardware. Experiments testify the effectiveness of the approach on a camera-enabled mobile phone.