QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review
IEEE Transactions on Pattern Analysis and Machine Intelligence
Ten myths of multimodal interaction
Communications of the ACM
Real-Time Fingertip Tracking and Gesture Recognition
IEEE Computer Graphics and Applications
Relevant Features for Video-Based Continuous Sign Language Recognition
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
A Multi-Class Pattern Recognition System for Practical Finger Spelling Translation
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality
Proceedings of the 5th international conference on Multimodal interfaces
The efficiency of multimodal interaction for a map-based task
ANLC '00 Proceedings of the sixth conference on Applied natural language processing
Escritoire: A Personal Projected Display
IEEE MultiMedia
Rapid Signer Adaptation for Isolated Sign Language Recognition
CVPRW '06 Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop
Going beyond the display: a surface technology with an electronically switchable diffuser
Proceedings of the 21st annual ACM symposium on User interface software and technology
Real-time hand-tracking with a color glove
ACM SIGGRAPH 2009 papers
Gesture in automatic discourse processing
Gesture in automatic discourse processing
A visual approach to sketched symbol recognition
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Incorporating motion data and cognitive models in IPS2
ICDHM'11 Proceedings of the Third international conference on Digital human modeling
Continuous body and hand gesture recognition for natural human-computer interaction
ACM Transactions on Interactive Intelligent Systems (TiiS) - Special Issue on Affective Interaction in Natural Environments
A hierarchical approach to continuous gesture analysis for natural multi-modal interaction
Proceedings of the 14th ACM international conference on Multimodal interaction
Plug&touch: a mobile interaction solution for large display via vision-based hand gesture detection
Proceedings of the 20th ACM international conference on Multimedia
On designing interactivity awareness for ambient displays
Multimedia Tools and Applications
Gesture spotting and recognition using salience detection and concatenated hidden markov models
Proceedings of the 15th ACM on International conference on multimodal interaction
| Hi-index | 0.00 |
Using a new hand tracking technology capable of tracking 3D hand postures in real-time, we developed a recognition system for continuous natural gestures. By natural gestures, we mean those encountered in spontaneous interaction, rather than a set of artificial gestures chosen to simplify recognition. To date we have achieved 95.6% accuracy on isolated gesture recognition, and 73% recognition rate on continuous gesture recognition, with data from 3 users and twelve gesture classes. We connected our gesture recognition system to Google Earth, enabling real time gestural control of a 3D map. We describe the challenges of signal accuracy and signal interpretation presented by working in a real-world environment, and detail how we overcame them.