An HMM-Based Threshold Model Approach for Gesture Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence
Self-contained Spatial Input Device for Wearable Computers
ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
Twiddler typing: one-handed chording text entry for mobile phones
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A one pass decoder design for large vocabulary recognition
HLT '94 Proceedings of the workshop on Human Language Technology
Gesture spotting with body-worn inertial sensors to detect user activities
Pattern Recognition
Wearable Activity Tracking in Car Manufacturing
IEEE Pervasive Computing
WUW - wear Ur world: a wearable gestural interface
CHI '09 Extended Abstracts on Human Factors in Computing Systems
Brainy hand: an ear-worn hand gesture interaction device
CHI '09 Extended Abstracts on Human Factors in Computing Systems
Gesture-Controlled User Input to Complete Questionnaires on Wrist-Worn Watches
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
Utilizing an Accelerometric Bracelet for Ubiquitous Gesture-Based Interaction
UAHCI '09 Proceedings of the 5th International on ConferenceUniversal Access in Human-Computer Interaction. Part II: Intelligent and Ubiquitous Interaction Environments
Airwriting recognition using wearable motion sensors
Proceedings of the 1st Augmented Human International Conference
Imaginary interfaces: spatial interaction with empty hands and without visual feedback
UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
Towards a one-way American sign language translator
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
1 thumb, 4 buttons, 20 words per minute: design and evaluation of H4-writer
Proceedings of the 24th annual ACM symposium on User interface software and technology
3D space handwriting recognition with ligature model
UCS'06 Proceedings of the Third international conference on Ubiquitous Computing Systems
Airwriting: demonstrating mobile text input by 3D-space handwriting
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
IEEE Transactions on Information Theory
ISWC '12 Proceedings of the 2012 16th Annual International Symposium on Wearable Computers (ISWC)
| Hi-index | 0.00 |
We present a wearable input system which enables interaction through 3D handwriting recognition. Users can write text in the air as if they were using an imaginary blackboard. The handwriting gestures are captured wirelessly by motion sensors applying accelerometers and gyroscopes which are attached to the back of the hand. We propose a two-stage approach for spotting and recognition of handwriting gestures. The spotting stage uses a support vector machine to identify those data segments which contain handwriting. The recognition stage uses hidden Markov models (HMMs) to generate a text representation from the motion sensor data. Individual characters are modeled by HMMs and concatenated to word models. Our system can continuously recognize arbitrary sentences, based on a freely definable vocabulary. A statistical language model is used to enhance recognition performance and to restrict the search space. We show that continuous gesture recognition with inertial sensors is feasible for gesture vocabularies that are several orders of magnitude larger than traditional vocabularies for known systems. In a first experiment, we evaluate the spotting algorithm on a realistic data set including everyday activities. In a second experiment, we report the results from a nine-user experiment on handwritten sentence recognition. Finally, we evaluate the end-to-end system on a small but realistic data set.