Using Multiple Sensors for Mobile Sign Language Recognition

Authors:
Helene Brashear;Thad Starner;Paul Lukowicz;Holger Junker
Affiliations:
-;-;-;-
Venue:
ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
Year:
2003

Citing 0
Cited 27

Georgia tech gesture toolkit: supporting experiments in gesture recognition

Proceedings of the 5th international conference on Multimodal interfaces
Representing Honey Bee Behavior for Recognition Using Human Trainable Models

Adaptive Behavior - Animals, Animats, Software Agents, Robots, Adaptive Systems
A gesture-based american sign language game for deaf children

CHI '05 Extended Abstracts on Human Factors in Computing Systems
Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning

IEEE Transactions on Pattern Analysis and Machine Intelligence
Development of an American Sign Language game for deaf children

Proceedings of the 2005 conference on Interaction design and children
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers

IEEE Transactions on Pattern Analysis and Machine Intelligence
American sign language recognition in game development for deaf children

Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility
Power and accuracy trade-offs in sound-based context recognition systems

Pervasive and Mobile Computing
Practical motion capture in everyday surroundings

ACM SIGGRAPH 2007 papers
Gesture spotting with body-worn inertial sensors to detect user activities

Pattern Recognition
Dealing with sensor displacement in motion-based onbody activity recognition systems

UbiComp '08 Proceedings of the 10th international conference on Ubiquitous computing
Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors

Proceedings of the 14th international conference on Intelligent user interfaces
Improving Spatial Reference in American Sign Language Animation through Data Collection from Native ASL Signers

UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
Accessible motion-capture glove calibration protocol for recording sign language data from deaf subjects

Proceedings of the 11th international ACM SIGACCESS conference on Computers and accessibility
Discriminative temporal smoothing for activity recognition from wearable sensors

UCS'07 Proceedings of the 4th international conference on Ubiquitous computing systems
mCube: towards a versatile gesture input device for ubiquitous computing environments

UCS'07 Proceedings of the 4th international conference on Ubiquitous computing systems
Airwriting recognition using wearable motion sensors

Proceedings of the 1st Augmented Human International Conference
Accurate and Accessible Motion-Capture Glove Calibration for Sign Language Data Collection

ACM Transactions on Accessible Computing (TACCESS)
Layered architecture for real time sign recognition: Hand gesture and movement

Engineering Applications of Artificial Intelligence
Automatic recognition of sign language subwords based on portable accelerometer and EMG sensors

International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Towards a one-way American sign language translator

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Collecting an american sign language corpus through the participation of native signers

UAHCI'11 Proceedings of the 6th international conference on Universal access in human-computer interaction: applications and services - Volume Part IV
American sign language recognition with the kinect

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Augmenting gesture recognition with erlang-cox models to identify neurological disorders in premature babies

Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Kinect-based visual communication system

Proceedings of the 4th International Conference on Internet Multimedia Computing and Service
Development of a single 3-axis accelerometer sensor based wearable gesture recognition band

UIC'07 Proceedings of the 4th international conference on Ubiquitous Intelligence and Computing
Non parametric, self organizing, scalable modeling of spatiotemporal inputs: The sign language paradigm

Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

We build upon a constrained, lab-based Sign Languagerecognition system with the goal of making it a mobile assistivetechnology. We examine using multiple sensors for disambiguationof noisy data to improve recognition accuracy.Our experiment compares the results of training a smallgesture vocabulary using noisy vision data, accelerometerdata and both data sets combined.