Writing and sketching in the air, recognizing and controlling on the fly

Authors:
Sharad Vikram;Lei Li;Stuart Russell
Affiliations:
University of California Berkeley, Berkeley, CA, USA;University of California Berkeley, Berkeley, CA, USA;University of California, Berkeley, Berkeley, California, USA
Venue:
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Year:
2013

Citing 5
Cited 0

On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey

IEEE Transactions on Pattern Analysis and Machine Intelligence
Markov models for offline handwriting recognition: a survey

International Journal on Document Analysis and Recognition
A Hilbert warping method for handwriting gesture recognition

Pattern Recognition
Recognizing sketched multistroke primitives

ACM Transactions on Interactive Intelligent Systems (TiiS)
Searching and mining trillions of time series subsequences under dynamic time warping

Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining

Quantified Score

Hi-index	0.00

Visualization

Abstract

Recent technologies in vision sensors are capable of capturing 3D finger positions and movements. We propose a novel way to control and interact with computers by moving fingers in the air. The positions of fingers are precisely captured by a computer vision device. By tracking the moving patterns of fingers, we can then recognize users' intended control commands or input information. We demonstrate this human input approach through an example application of handwriting recognition. By treating the input as a time series of 3D positions, we propose a fast algorithm using dynamic time warping to recognize characters in online fashion. We employ various optimization techniques to recognize in real time as one writes. Experiments show promising recognition performance and speed.