Evaluation of an on-line adaptive gesture interface with command prediction

Authors:
Xiang Cao;Ravin Balakrishnan
Affiliations:
University of Toronto;University of Toronto
Venue:
GI '05 Proceedings of Graphics Interface 2005
Year:
2005

Citing 19
Cited 4

Specifying gestures by example

Proceedings of the 18th annual conference on Computer graphics and interactive techniques
Concept features in Re:Agent, an intelligent Email agent

AGENTS '98 Proceedings of the second international conference on Autonomous agents
Gesture VR: vision-based 3D hand interace for spatial interaction

MULTIMEDIA '98 Proceedings of the sixth ACM international conference on Multimedia
User modeling in adaptive interfaces

UM '99 Proceedings of the seventh international conference on User modeling
Finding all periodic orbits of maps using Newton methods: sizes of basins

Physica D
Interaction techniques for ambiguity resolution in recognition-based interfaces

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Dasher—a data entry interface using continuous gestures and language models

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
An evaluation of a multiple interface design solution for bloated software

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Writer Adaptation for Online Handwriting Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Visual instruments for an interactive mural

CHI '99 Extended Abstracts on Human Factors in Computing Systems
Interactive object registration and recognition for augmented desk interface

CHI '01 Extended Abstracts on Human Factors in Computing Systems
XWand: UI for intelligent spaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real-Time Online Adaptive Gesture Recognition

RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Adaptive models for the recognition of human gesture

Adaptive models for the recognition of human gesture
Synchronous gestures for multiple persons and computers

Proceedings of the 16th annual ACM symposium on User interface software and technology
VisionWand: interaction techniques for large displays using a passive wand tracked in 3D

Proceedings of the 16th annual ACM symposium on User interface software and technology
Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays

Proceedings of the 16th annual ACM symposium on User interface software and technology
Syskill & webert: Identifying interesting web sites

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1
User adaptive handwriting recognition by self-growing probabilistic decision-based neural networks

IEEE Transactions on Neural Networks

GSI demo: multiuser gesture/speech interaction over digital tables by wrapping single user applications

Proceedings of the 8th international conference on Multimodal interfaces
Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes

Proceedings of the 20th annual ACM symposium on User interface software and technology
Architecture of Multiple Algorithm Integration for Real-Time Image Understanding Application

AICI '09 Proceedings of the International Conference on Artificial Intelligence and Computational Intelligence
Simpleflow: enhancing gestural interaction with gesture prediction, abbreviation and autocompletion

INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present an evaluation of a hybrid gesture interface framework that combines on-line adaptive gesture recognition with a command predictor. Machine learning techniques enable on-line adaptation to differences in users' input patterns when making gestures, and exploit regularities in command sequences to improve recognition performance. A prototype using 2D single-stroke gestures was implemented with a minimally intrusive user interface for on-line re-training. Results of a controlled user experiment show that the hybrid adaptive system significantly improved overall gesture recognition performance, and reduced users' need to practice making the gestures before achieving good results.