Fluid gesture interaction design: Applications of continuous recognition for the design of modern gestural interfaces

Authors:
Bruno Zamborlin;Frederic Bevilacqua;Marco Gillies;Mark D'inverno
Affiliations:
Goldsmiths, University of London and IRCAM STMS-CNRS-UPMC, London, UK;IRCAM STMS-CNRS-UPMC, Paris, France;Goldsmiths, University of London, London, UK;Goldsmiths, University of London, London, UK
Venue:
ACM Transactions on Interactive Intelligent Systems (TiiS)
Year:
2014

Citing 27
Cited 0

Parametric Hidden Markov Models for Gesture Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Fluid interaction with high-resolution wall-size displays

Proceedings of the 14th annual ACM symposium on User interface software and technology
Interactive machine learning

Proceedings of the 8th international conference on Intelligent user interfaces
A design tool for camera-based interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Georgia tech gesture toolkit: supporting experiments in gesture recognition

Proceedings of the 5th international conference on Multimodal interfaces
VisionWand: interaction techniques for large displays using a passive wand tracked in 3D

Proceedings of the 16th annual ACM symposium on User interface software and technology
Stitching: pen gestures that span multiple displays

Proceedings of the working conference on Advanced visual interfaces
AppLens and launchTile: two designs for one-handed thumb use on small devices

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
OpenSound Control: state of the art 2003

NIME '03 Proceedings of the 2003 conference on New interfaces for musical expression
Cooperative gestures: multi-user gestural interactions for co-located groupware

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)

Data Mining: Practical Machine Learning Tools and Techniques, Second Edition (Morgan Kaufmann Series in Data Management Systems)
Authoring sensor-based interactions by demonstration with direct manipulation and pattern recognition

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Problems and Prospects for Intimate Musical Control of Computers

Computer Music Journal
Wireless sensor interface and gesture-follower for music pedagogy

NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
Move to get moved: a search for methods, tools and knowledge to design for expressive and rich movement-based interaction

Personal and Ubiquitous Computing
ActionCube: a tangible mobile gesture interaction tutorial

Proceedings of the 2nd international conference on Tangible and embedded interaction
Real-Time Gesture Recognition, Evaluation and Feed-Forward Correction of a Multimodal Tai-Chi Platform

HAID '08 Proceedings of the 3rd international workshop on Haptic and Audio Interaction Design
Unravelling seams: improving mobile gesture recognition with visual feedback techniques

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User-defined gestures for surface computing

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
MAGIC: a motion gesture design tool

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real-time interaction with supervised learning

CHI '10 Extended Abstracts on Human Factors in Computing Systems
Human model evaluation in interactive supervised learning

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User-defined motion gestures for mobile interaction

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Continuous realtime gesture following and recognition

GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Gesture coder: a tool for programming multi-touch gestures by demonstration

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gesture Recognition: A Survey

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Machine Recognition of Human Activities: A Survey

IEEE Transactions on Circuits and Systems for Video Technology

Quantified Score

Hi-index	0.00

Visualization

Abstract

This article presents Gesture Interaction DEsigner (GIDE), an innovative application for gesture recognition. Instead of recognizing gestures only after they have been entirely completed, as happens in classic gesture recognition systems, GIDE exploits the full potential of gestural interaction by tracking gestures continuously and synchronously, allowing users to both control the target application moment to moment and also receive immediate and synchronous feedback about system recognition states. By this means, they quickly learn how to interact with the system in order to develop better performances. Furthermore, rather than learning the predefined gestures of others, GIDE allows users to design their own gestures, making interaction more natural and also allowing the applications to be tailored by users' specific needs. We describe our system that demonstrates these new qualities—that combine to provide fluid gesture interaction design—through evaluations with a range of performers and artists.