A Real-Time Continuous Gesture Recognition System for Sign Language
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Relevant Features for Video-Based Continuous Sign Language Recognition
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
A framework for motion recognition with applications to American sign language and gait recognition
HUMO '00 Proceedings of the Workshop on Human Motion (HUMO'00)
ASL Recognition Based on a Coupling Between HMMs and 3D Motion Analysis
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Using Multiple Sensors for Mobile Sign Language Recognition
ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
Georgia tech gesture toolkit: supporting experiments in gesture recognition
Proceedings of the 5th international conference on Multimodal interfaces
Large vocabulary sign language recognition based on hierarchical decision trees
Proceedings of the 5th international conference on Multimodal interfaces
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning
IEEE Transactions on Pattern Analysis and Machine Intelligence
Real-time Hand Pose Recognition Using Low-Resolution Depth Images
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
American sign language recognition in game development for deaf children
Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Image Processing, Analysis, and Machine Vision
Image Processing, Analysis, and Machine Vision
Real-time hand-tracking with a color glove
ACM SIGGRAPH 2009 papers
Sign Language Recognition: Working with Limited Corpora
UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
IEEE Transactions on Pattern Analysis and Machine Intelligence
ICLS '10 Proceedings of the 9th International Conference of the Learning Sciences - Volume 2
American Sign Language Phrase Verification in an Educational Game for Deaf Children
ICPR '10 Proceedings of the 2010 20th International Conference on Pattern Recognition
Using a depth camera as a touch sensor
ACM International Conference on Interactive Tabletops and Surfaces
A new instrumented approach for translating American sign language into sound and text
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Transition movement models for large vocabulary continuous sign language recognition
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
A boosted classifier tree for hand shape detection
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Improving the efficacy of automated sign language practice tools
Improving the efficacy of automated sign language practice tools
Real-time human pose recognition in parts from single depth images
CVPR '11 Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition
A dynamic gesture recognition system for the Korean sign language (KSL)
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Hands-up: motion recognition using kinect and a ceiling to improve the convenience of human life
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Vision-based handwriting recognition for unrestricted text input in mid-air
Proceedings of the 14th ACM international conference on Multimodal interaction
Methodological foundation for sign language 3d motion trajectory analysis
IDA'12 Proceedings of the 11th international conference on Advances in Intelligent Data Analysis
Eyes-free interaction with free-hand gestures and auditory menus
International Journal of Human-Computer Studies
Sign language recognition using sub-units
The Journal of Machine Learning Research
VisualComm: a tool to support communication between deaf and hearing persons with the Kinect
Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility
MLDM'13 Proceedings of the 9th international conference on Machine Learning and Data Mining in Pattern Recognition
Evaluating landmark attraction model in collaborative wayfinding in virtual learning environments
Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia
Journal of Visual Communication and Image Representation
| Hi-index | 0.00 |
We investigate the potential of the Kinect depth-mapping camera for sign language recognition and verification for educational games for deaf children. We compare a prototype Kinect-based system to our current CopyCat system which uses colored gloves and embedded accelerometers to track children's hand movements. If successful, a Kinect-based approach could improve interactivity, user comfort, system robustness, system sustainability, cost, and ease of deployment. We collected a total of 1000 American Sign Language (ASL) phrases across both systems. On adult data, the Kinect system resulted in 51.5% and 76.12% sentence verification rates when the users were seated and standing respectively. These rates are comparable to the 74.82% verification rate when using the current(seated) CopyCat system. While the Kinect computer vision system requires more tuning for seated use, the results suggest that the Kinect may be a viable option for sign verification.