The State of the Art in Online Handwriting Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Integrating gesture and snapping into a user interface toolkit
UIST '90 Proceedings of the 3rd annual ACM SIGGRAPH symposium on User interface software and technology
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Specifying gestures by example
Proceedings of the 18th annual conference on Computer graphics and interactive techniques
Extending an existing user interface toolkit to support gesture recognition
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems
The Amulet Environment: New Models for Effective User Interface Software Development
IEEE Transactions on Software Engineering
Implications for a gesture design tool
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence
DENIM: finding a tighter fit between tools and practice for Web site design
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
SATIN: a toolkit for informal ink-based applications
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Fluid interaction with high-resolution wall-size displays
Proceedings of the 14th annual ACM symposium on User interface software and technology
Machine Learning
Shorthand writing on stylus keyboard
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
XWand: UI for intelligent spaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
VisionWand: interaction techniques for large displays using a passive wand tracked in 3D
Proceedings of the 16th annual ACM symposium on User interface software and technology
Stitching: pen gestures that span multiple displays
Proceedings of the working conference on Advanced visual interfaces
SHARK2: a large vocabulary shorthand writing system for pen-based computers
Proceedings of the 17th annual ACM symposium on User interface software and technology
HMM-based efficient sketch recognition
Proceedings of the 10th international conference on Intelligent user interfaces
AppLens and launchTile: two designs for one-handed thumb use on small devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Evaluation of an on-line adaptive gesture interface with command prediction
GI '05 Proceedings of Graphics Interface 2005
Cooperative gestures: multi-user gestural interactions for co-located groupware
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Information Sciences: an International Journal
OctoPocus: a dynamic guide for learning gesture-based command sets
Proceedings of the 21st annual ACM symposium on User interface software and technology
Iterative design and evaluation of an event architecture for pen-and-paper interfaces
Proceedings of the 21st annual ACM symposium on User interface software and technology
Gesture Recognition Based on Manifold Learning
SSPR & SPR '08 Proceedings of the 2008 Joint IAPR International Workshop on Structural, Syntactic, and Statistical Pattern Recognition
Structuring and manipulating hand-drawn concept maps
Proceedings of the 14th international conference on Intelligent user interfaces
Technical Section: Sketch-based modeling: A survey
Computers and Graphics
Spatially aware handhelds for high-precision tangible interaction with large displays
Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
Sketch and run: a stroke-based interface for home robots
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Musink: composing music through augmented drawing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Unravelling seams: improving mobile gesture recognition with visual feedback techniques
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
GestureBar: improving the approachability of gesture-based interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Using strokes as command shortcuts: cognitive benefits and toolkit support
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Who dotted that 'i'?: context free user differentiation through pressure and tilt pen data
Proceedings of Graphics Interface 2009
Recognizing interspersed sketches quickly
Proceedings of Graphics Interface 2009
Automatic evaluation of sketch recognizers
Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling
Revisiting ShortStraw: improving corner finding in sketch-based interfaces
Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling
Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling
Games for sketch data collection
Proceedings of the 6th Eurographics Symposium on Sketch-Based Interfaces and Modeling
Computational Support for Sketching in Design: A Review
Foundations and Trends in Human-Computer Interaction
UAHCI '09 Proceedings of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. Part II: Intelligent and Ubiquitous Interaction Environments
Mouse 2.0: multi-touch meets the mouse
Proceedings of the 22nd annual ACM symposium on User interface software and technology
uWave: Accelerometer-based personalized gesture recognition and its applications
Pervasive and Mobile Computing
A gestural interaction design model for multi-touch displays
Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Proceedings of the 15th international conference on Intelligent user interfaces
The $3 recognizer: simple 3D gesture recognition on mobile devices
Proceedings of the 15th international conference on Intelligent user interfaces
CRISTAL: a collaborative home media and device controller based on a multi-touch display
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
d.note: revising user interfaces through change tracking, annotations, and alternatives
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Scale detection for a priori gesture recognition
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Let's play chinese characters: mobile learning approaches via culturally inspired group games
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Protractor: a fast and accurate gesture recognizer
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sketched menu: a tabletop-menu technique for GUI object creation
Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
Letras: an architecture and framework for ubiquitous pen-and-paper interaction
Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
A lightweight multistroke recognizer for user interface prototypes
Proceedings of Graphics Interface 2010
Knotty gestures: subtle traces to support interactive use of paper
Proceedings of the International Conference on Advanced Visual Interfaces
Gestalt: integrated support for implementation and analysis in machine learning
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Gesture search: a tool for fast mobile data access
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Enhancing single touch gesture classifiers to multitouch support
ICCHP'10 Proceedings of the 12th international conference on Computers helping people with special needs
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
Stroke extraction and classification for mesh inflation
Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium
The power of automatic feature selection: Rubine on steroids
Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium
Rata.SSR: data mining for pertinent stroke recognizers
Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium
What caused that touch?: expressive interaction with a surface through fiduciary-tagged gloves
ACM International Conference on Interactive Tabletops and Surfaces
Sketched menus and iconic gestures, techniques designed in the context of shareable interfaces
ACM International Conference on Interactive Tabletops and Surfaces
Surface-poker: multimodality in tabletop games
ACM International Conference on Interactive Tabletops and Surfaces
A language to define multi-touch interactions
ACM International Conference on Interactive Tabletops and Surfaces
Online gesture recognition for user interface on accelerometer built-in mobile phones
ICONIP'10 Proceedings of the 17th international conference on Neural information processing: models and applications - Volume Part II
Protractor3D: a closed-form solution to rotation-invariant 3D gestures
Proceedings of the 16th international conference on Intelligent user interfaces
IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I
SPARSH: passing data using the body as a medium
Proceedings of the ACM 2011 conference on Computer supported cooperative work
Technical Section: SpeedSeg: A technique for segmenting pen strokes using pen speed
Computers and Graphics
Curved-straight lines-analysis (CSLA) algorithm for handwritten digit recognition enhancement
Proceedings of the First International Conference on Intelligent Interactive Technologies and Multimedia
The aligned rank transform for nonparametric factorial analyses using only anova procedures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Experimental analysis of touch-screen gesture designs in mobile environments
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Eden: a professional multitouch tool for constructing virtual organic environments
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
DoubleFlip: a motion gesture delimiter for mobile interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Touch and copy, touch and paste
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Towards a unified gesture description language
Proceedings of the 13th International Conference on Humans and Computers
Using mobile phones to write in air
MobiSys '11 Proceedings of the 9th international conference on Mobile systems, applications, and services
Defining precise measurements with sketched annotations
Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
Sketch express: facial expressions made easy
Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
Continuous recognition and visualization of pen strokes and touch-screen gestures
Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
ClassySeg: a machine learning approach to automatic stroke segmentation
Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
Recognizing sketched multistroke primitives
ACM Transactions on Interactive Intelligent Systems (TiiS)
Using mobile projection to support guitar learning
SG'11 Proceedings of the 11th international conference on Smart graphics
Mutual information based gesture recognition
CAIP'11 Proceedings of the 14th international conference on Computer analysis of images and patterns - Volume Part I
Understanding, Manipulating and Searching Hand-Drawn Concept Maps
ACM Transactions on Intelligent Systems and Technology (TIST)
Simpleflow: enhancing gestural interaction with gesture prediction, abbreviation and autocompletion
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part I
Estimating the perceived difficulty of pen gestures
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
Sketch-sketch revolution: an engaging tutorial system for guided sketching and application learning
Proceedings of the 24th annual ACM symposium on User interface software and technology
Proceedings of the 24th annual ACM symposium on User interface software and technology
A domain specific language to define gestures for multi-touch applications
Proceedings of the 10th Workshop on Domain-Specific Modeling
The effect of sampling rate on the performance of template-based gesture recognizers
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Designing user-, hand-, and handpart-aware tabletop interactions with the TouchID toolkit
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Multiscale detection of gesture patterns in continuous motion trajectories
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction
6DMG: a new 6D motion gesture database
Proceedings of the 3rd Multimedia Systems Conference
An adaptive solution for intra-operative gesture-based human-machine interaction
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
1F: one accessory feature design for gesture recognizers
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
A modular approach to gesture recognition for interaction with a domestic service robot
ICIRA'11 Proceedings of the 4th international conference on Intelligent Robotics and Applications - Volume Part II
Towards locally and globally shape-aware reverse 3D modeling
Computer-Aided Design
Rock-paper-fibers: bringing physical affordance to mobile touch devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User learning and performance with bezel menus
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A comparative evaluation of finger and pen stroke gestures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gesture coder: a tool for programming multi-touch gestures by demonstration
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Bootstrapping personal gesture shortcuts with the wisdom of the crowd and handwriting recognition
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
GestureCommander: continuous touch-based gesture prediction
CHI '12 Extended Abstracts on Human Factors in Computing Systems
SpeckleEye: gestural interaction for embedded electronics in ubiquitous computing
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Sketch recognition algorithms for comparing complex and unpredictable shapes
IJCAI'11 Proceedings of the Twenty-Second international joint conference on Artificial Intelligence - Volume Volume Three
$N-protractor: a fast and accurate multistroke recognizer
Proceedings of Graphics Interface 2012
Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems
Small gestures go a long way: how many bits per gesture do recognizers actually need?
Proceedings of the Designing Interactive Systems Conference
Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling
The 1¢ Recognizer: a fast, accurate, and easy-to-implement handwritten gesture recognition technique
Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling
Newtons Pen II: an intelligent, sketch-based tutoring system and its sketch processing techniques
Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling
Searching and mining trillions of time series subsequences under dynamic time warping
Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining
Special Section on CANS: Sketch express: A sketching interface for facial animation
Computers and Graphics
Proceedings of the 12th International Conference on Knowledge Management and Knowledge Technologies
GeForMTjs: a javascript library based on a domain specific language for multi-touch gestures
ICWE'12 Proceedings of the 12th international conference on Web Engineering
HBF49 feature set: A first unified baseline for online symbol recognition
Pattern Recognition
Proceedings of the 2012 ACM Conference on Ubiquitous Computing
RATA: codeless generation of gesture recognizers
BCS-HCI '12 Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers
Designing graphical user interfaces integrating gestures
Proceedings of the 30th ACM international conference on Design of communication
Proceedings of the 25th annual ACM symposium on User interface software and technology
Proton++: a customizable declarative multitouch framework
Proceedings of the 25th annual ACM symposium on User interface software and technology
ShortStraw: a simple and effective corner finder for polylines
SBM'08 Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling
From paper to machine: extracting strokes from images for use in sketch recognition
SBM'08 Proceedings of the Fifth Eurographics conference on Sketch-Based Interfaces and Modeling
Gestures as point clouds: a $P recognizer for user interface prototypes
Proceedings of the 14th ACM international conference on Multimodal interaction
Kinected browser: depth camera interaction for the web
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Coupling gestures with tactile feedback: a comparative user study
Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Caesar: an intelligent domestic service robot
Intelligent Service Robotics
The impact of motion dimensionality and bit cardinality on the design of 3D gesture recognizers
International Journal of Human-Computer Studies
GestureAgents: an agent-based framework for concurrent multi-task multi-user interaction
Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction
An exploration of pen tail gestures for interactions
International Journal of Human-Computer Studies
Designing gestural interfaces for the interactive TV
Proceedings of the 11th european conference on Interactive TV and video
Memorability of pre-designed and user-defined gesture sets
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Learning and performance with gesture guides
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Your left hand can do it too!: investigating intermanual, symmetric gesture transfer on touchscreens
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The challenges and potential of end-user gesture customization
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Template based classification of multi-touch gestures
Pattern Recognition
Error-proof, high-performance, and context-aware gestures for interactive text edition
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Beyond recognition: using gesture variation for continuous interaction
CHI '13 Extended Abstracts on Human Factors in Computing Systems
EventHurdle: supporting designers' exploratory interaction prototyping with gesture-based sensors
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Small, medium, or large?: estimating the user-perceived scale of stroke gestures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Augmented letters: mnemonic gesture-based shortcuts
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gestures and widgets: performance in text editing on multi-touch capable mobile devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A comparative evaluation of touch and pen gestures for adult and child users
Proceedings of the 12th International Conference on Interaction Design and Children
Supervised machine learning for grouping sketch diagram strokes
Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling
ACM Transactions on Knowledge Discovery from Data (TKDD) - Special Issue on ACM SIGKDD 2012
FingerPad: private and subtle interaction using fingertips
Proceedings of the 26th annual ACM symposium on User interface software and technology
CrowdLearner: rapidly creating mobile recognizers using crowdsourcing
Proceedings of the 26th annual ACM symposium on User interface software and technology
Surround-see: enabling peripheral vision on smartphones during active use
Proceedings of the 26th annual ACM symposium on User interface software and technology
The Journal of Machine Learning Research
Interpretation of strokes in radial menus: The case of the KeyScretch text entry method
Journal of Visual Languages and Computing
Exploring modeling language for multi-touch systems using petri nets
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Pen and touch gestural environment for document editing on interactive tabletops
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Relative accuracy measures for stroke gestures
Proceedings of the 15th ACM on International conference on multimodal interaction
User perceptions of drawing logic diagrams with pen-centric user interfaces
Proceedings of Graphics Interface 2013
Understanding the consistency of users' pen and finger stroke gesture articulation
Proceedings of Graphics Interface 2013
Data mining a trillion time series subsequences under dynamic time warping
IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence
FingerInk: turn your glass into a digital board
Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration
Teaching motion gestures via recognizer feedback
Proceedings of the 19th international conference on Intelligent User Interfaces
Technical Section: A machine learning approach to automatic stroke segmentation
Computers and Graphics
Home-based computerized cognitive assessment tool for dementia screening
Journal of Ambient Intelligence and Smart Environments - Home-based Health and Wellness Measurement and Monitoring
Journal of Ambient Intelligence and Smart Environments
Hi-index | 0.00 |
Although mobile, tablet, large display, and tabletop computers increasingly present opportunities for using pen, finger, and wand gestures in user interfaces, implementing gesture recognition largely has been the privilege of pattern matching experts, not user interface prototypers. Although some user interface libraries and toolkits offer gesture recognizers, such infrastructure is often unavailable in design-oriented environments like Flash, scripting environments like JavaScript, or brand new off-desktop prototyping environments. To enable novice programmers to incorporate gestures into their UI prototypes, we present a "$1 recognizer" that is easy, cheap, and usable almost anywhere in about 100 lines of code. In a study comparing our $1 recognizer, Dynamic Time Warping, and the Rubine classifier on user-supplied gestures, we found that $1 obtains over 97% accuracy with only 1 loaded template and 99% accuracy with 3+ loaded templates. These results were nearly identical to DTW and superior to Rubine. In addition, we found that medium-speed gestures, in which users balanced speed and accuracy, were recognized better than slow or fast gestures for all three recognizers. We also discuss the effect that the number of templates or training examples has on recognition, the score falloff along recognizers' N-best lists, and results for individual gestures. We include detailed pseudocode of the $1 recognizer to aid development, inspection, extension, and testing.