Motion analysis of grammatical processes in a visual-gestural language
Proc. of the ACM SIGGRAPH/SIGART interdisciplinary workshop on Motion: representation and perception
Recognition of sign language motion images
Pattern Recognition
Gesture recognition using recurrent neural networks
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
IEEE Spectrum
IEEE Computer Graphics and Applications
Visual tracking of high DOF articulated structures: an application to human hand tracking
ECCV '94 Proceedings of the third European conference on Computer Vision (Vol. II)
Active shape models—their training and application
Computer Vision and Image Understanding
Toward a vision-based hand gesture interface
VRST '94 Proceedings of the conference on Virtual reality software and technology
Dimension reduction by local principal component analysis
Neural Computation
Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review
IEEE Transactions on Pattern Analysis and Machine Intelligence
A hand gesture interface device
CHI '87 Proceedings of the SIGCHI/GI Conference on Human Factors in Computing Systems and Graphics Interface
Statistical methods for speech recognition
Statistical methods for speech recognition
Sign language recognition using model-based tracking and a 3D Hopfield neural network
Machine Vision and Applications
Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video
IEEE Transactions on Pattern Analysis and Machine Intelligence
Put that where? voice and gesture at the graphics interface
ACM SIGGRAPH Computer Graphics
The visual analysis of human movement: a survey
Computer Vision and Image Understanding
A Learning-Based Prediction-and-Verification Segmentation Scheme for Hand Sign Image Sequence
IEEE Transactions on Pattern Analysis and Machine Intelligence
Parametric Hidden Markov Models for Gesture Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Pattern Analysis and Machine Intelligence
Perceptual user interfaces: things that see
Communications of the ACM
Looking at People: Sensing for Ubiquitous and Wearable Computing
IEEE Transactions on Pattern Analysis and Machine Intelligence
IEEE Transactions on Pattern Analysis and Machine Intelligence
Appearance-based hand sign recognition from intensity image sequences
Computer Vision and Image Understanding
Development of an information kiosk with a sign language recognition system
CUU '00 Proceedings on the 2000 conference on Universal Usability
Automatic Analysis of Facial Expressions: The State of the Art
IEEE Transactions on Pattern Analysis and Machine Intelligence
A model-based hand gesture recognition system
Machine Vision and Applications
A framework for recognizing the simultaneous aspects of American sign language
Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
Recognition of gestures in Arabic sign language using neuro-fuzzy systems
Artificial Intelligence
Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Learning Comprehensible Descriptions of Multivariate Time Series
ICML '99 Proceedings of the Sixteenth International Conference on Machine Learning
Towards Appearance-Based Multi-Channel Gesture Recognition
Proceedings of Gesture Workshop on Progress in Gestural Interaction
Hand Tension as a Gesture Segmentation Cue
Proceedings of Gesture Workshop on Progress in Gestural Interaction
Automatic Estimation of Body Regions from Video Images
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Video-Based Sign Language Recognition Using Hidden Markov Models
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Progress in Sign Languages Recognition
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Corpus 3D Natural Movements and Sign Language Primitives of Movement
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Towards a Dialogue System Based on Recognition and Synthesis of Japanese Sign Language
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
The Recognition Algorithm with Non-contact for Japanese Sign Language Using Morphological Analysis
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
A Method for Analyzing Spatial Relationships Between Words in Sign Language Recognition
GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
Research on Computer Science and Sign Language: Ethical Aspects
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
The Recognition of Finger-Spelling for Chinese Sign Language
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Towards an Automatic Sign Language Recognition System Using Subunits
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Notation System and Statistical Analysis of NMS in JSL
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Signer-Independent Continuous Sign Language Recognition Based on SRN/HMM
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
ARGo: An Architecture for Sign Language Recognition and Interpretation
Proceedings of Gesture Workshop on Progress in Gestural Interaction
Real-time Video-based Recognition of Sign Language Gestures using Guided Template Matching
Proceedings of Gesture Workshop on Progress in Gestural Interaction
A Real-Time Large Vocabulary Continuous Recognition System for Chinese Sign Language
PCM '01 Proceedings of the Second IEEE Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Hands Tracking from Frontal View for Vision-Based Gesture Recognition
Proceedings of the 24th DAGM Symposium on Pattern Recognition
Real-Time Hand-Arm Motion Analysis using a single Video Camera
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
A Real-Time Continuous Gesture Recognition System for Sign Language
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Color-Based Hands Tracking System for Sign Language Recognition
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Real Time Gesture Recognition Using Eigenspace from Multi Input Image Sequence
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
View-Based Active Appearance Models
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
A framework for motion recognition with applications to American sign language and gait recognition
HUMO '00 Proceedings of the Workshop on Human Motion (HUMO'00)
Partly-Hidden Markov Model and its Application to Gesture Recognition
ICASSP '97 Proceedings of the 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '97) -Volume 4 - Volume 4
ICCV '95 Proceedings of the Fifth International Conference on Computer Vision
Recognition Approach to Gesture Language Understanding
ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
Real-Time Facial Expression Recognition Based on Features' Positions on Dimensions
ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
A Novel Two-Layer PCA/MDA Scheme for Hand Posture Recognition
ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1 - Volume 1
Automatic Detection of Relevant Head Gestures in American Sign Language Communication
ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1 - Volume 1
Recognition of Strong and Weak Connection Models in Continuous Sign Language
ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1 - Volume 1
A Multi-Class Pattern Recognition System for Practical Finger Spelling Translation
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
An Approach Based on Phonemes to Large Vocabulary Chinese Sign Language Recognition
FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Recognition of Asymmetric Facial Action Unit Activities and Intensities
ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 1
Affine Real-Time Face Tracking using Gabor Wavelet Networks
ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 1
Recognition of Local Features for Camera-Based Sign Language Recognition System
ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 4
Extraction of 3D Hand Shape and Posture from Image Sequences for Sign Language Recognition
AMFG '03 Proceedings of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures
Using Multiple Sensors for Mobile Sign Language Recognition
ISWC '03 Proceedings of the 7th IEEE International Symposium on Wearable Computers
American sign language recognition: reducing the complexity of the task with phoneme-based modeling and parallel hidden markov models
Recent advances in visual and infrared face recognition: a review
Computer Vision and Image Understanding
3-D hand trajectory recognition for signing exact English
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
A new instrumented approach for translating American sign language into sound and text
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Transition movement models for large vocabulary continuous sign language recognition
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Deciphering gestures with layered meanings and signer adaptation
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Towards a one-way American sign language translator
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
A boosted classifier tree for hand shape detection
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Multimodal integration-a statistical view
IEEE Transactions on Multimedia
A fuzzy rule-based approach to spatio-temporal hand gesturerecognition
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Gesture-based interaction and communication: automated classification of hand gesture contours
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
A dynamic gesture recognition system for the Korean sign language (KSL)
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Modeling and recognition of hand gesture using colored Petri nets
IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans
Visual recognition of continuous hand postures
IEEE Transactions on Neural Networks
Bayesian network based human pose estimation
AIA'06 Proceedings of the 24th IASTED international conference on Artificial intelligence and applications
IEEE Transactions on Pattern Analysis and Machine Intelligence
Viewpoint invariant sign language recognition
Computer Vision and Image Understanding
Variable frame rate for low power mobile sign language communication
Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
Signing Exact English (SEE): Modeling and recognition
Pattern Recognition
Signing Exact English (SEE): Modeling and recognition
Pattern Recognition
Cued speech gesture recognition: a first prototype based on early reduction
Journal on Image and Video Processing
Image and video for hearing impaired people
Journal on Image and Video Processing
Proceedings of the 1st international conference on PErvasive Technologies Related to Assistive Environments
Human-Centred Intelligent Human Computer Interaction (HCI²): how far are we from attaining it?
International Journal of Autonomous and Adaptive Communications Systems
Definition and recovery of kinematic features for recognition of American sign language movements
Image and Vision Computing
Speech to sign language translation system for Spanish
Speech Communication
View invariant gesture recognition using the CSEM SwissRanger SR-2 camera
International Journal of Intelligent Systems Technologies and Applications
Taiwan sign language (TSL) recognition based on 3D data and neural networks
Expert Systems with Applications: An International Journal
View-Invariant Pose Recognition Using Multilinear Analysis and the Universum
ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing, Part II
Multimedia Tools and Applications
Enhancing a Sign Language Translation System with Vision-Based Features
Gesture-Based Human-Computer Interaction and Simulation
Sequential Belief-Based Fusion of Manual and Non-manual Information for Recognizing Isolated Signs
Gesture-Based Human-Computer Interaction and Simulation
Synthetic data generation technique in Signer-independent sign language recognition
Pattern Recognition Letters
Computer Vision and Image Understanding
Coupled grouping and matching for sign and gesture recognition
Computer Vision and Image Understanding
Two gesture recognition systems for immersive math education of the deaf
Proceedings of the First International Conference on Immersive Telecommunications
Smoothed Disparity Maps for Continuous American Sign Language Recognition
IbPRIA '09 Proceedings of the 4th Iberian Conference on Pattern Recognition and Image Analysis
Towards automated large vocabulary gesture search
Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments
Recognizing body poses using multilinear analysis and semi-supervised learning
Pattern Recognition Letters
A Similarity Measure for Vision-Based Sign Recognition
UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Addressing Diversity. Part I: Held as Part of HCI International 2009
Automatic Translation System to Spanish Sign Language with a Virtual Interpreter
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Modelling and recognition of the linguistic components in American Sign Language
Image and Vision Computing
Proceedings of the 27th ACM international conference on Design of communication
Activity analysis enabling real-time video communication on mobile phones for deaf users
Proceedings of the 22nd annual ACM symposium on User interface software and technology
A framework for continuous multimodal sign language recognition
Proceedings of the 2009 international conference on Multimodal interfaces
SOMM: Self organizing Markov map for gesture recognition
Pattern Recognition Letters
Spoken Spanish generation from sign language
Interacting with Computers
A visual system for hand gesture recognition in human-computer interaction
SCIA'07 Proceedings of the 15th Scandinavian conference on Image analysis
Human pose estimation using a mixture of Gaussians based image modeling
HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
Cued Speech automatic recognition in normal-hearing and deaf subjects
Speech Communication
Sign recognition using constrained optimization
ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part II
Probabilistic video-based gesture recognition using self-organizing feature maps
ICANN'07 Proceedings of the 17th international conference on Artificial neural networks
A database-based framework for gesture recognition
Personal and Ubiquitous Computing
Feature extraction based on multiphase level set framework for sign language recognition system
Proceedings of the 1st Amrita ACM-W Celebration on Women in Computing in India
ICAISC'10 Proceedings of the 10th international conference on Artifical intelligence and soft computing: Part II
Challenges of human behavior understanding
HBU'10 Proceedings of the First international conference on Human behavior understanding
Feature representations for the recognition of 3D emblematic gestures
HBU'10 Proceedings of the First international conference on Human behavior understanding
Automatic recognition of sign language subwords based on portable accelerometer and EMG sensors
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Sign language recognition using a combination of new vision based features
Pattern Recognition Letters
Multifactor feature extraction for human movement recognition
Computer Vision and Image Understanding
Recognizing continuous grammatical marker facial gestures in sign language video
ACCV'10 Proceedings of the 10th Asian conference on Computer vision - Volume Part IV
Local binary pattern based features for sign language recognition
Pattern Recognition and Image Analysis
Towards automatic annotation of sign language dictionary corpora
TSD'11 Proceedings of the 14th international conference on Text, speech and dialogue
Gaussian Process Dynamical Models for hand gesture interpretation in Sign Language
Pattern Recognition Letters
American sign language recognition with the kinect
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Facial expressions in American sign language: Tracking and recognition
Pattern Recognition
Real-time viewpoint-invariant hand localization with cluttered backgrounds
Image and Vision Computing
A natural interface for sign language mathematics
ISVC'06 Proceedings of the Second international conference on Advances in Visual Computing - Volume Part I
Body posture estimation in sign language videos
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Influence of handshape information on automatic sign language recognition
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
MRCS'06 Proceedings of the 2006 international conference on Multimedia Content Representation, Classification and Security
Short communication: Selective Subsequence Time Series clustering
Knowledge-Based Systems
LSESpeak: A spoken language generator for Deaf people
Expert Systems with Applications: An International Journal
Increasing adaptability of a speech into sign language translation system
Expert Systems with Applications: An International Journal
Modelling and recognition of signed expressions using subunits obtained by data---driven approach
AIMSA'12 Proceedings of the 15th international conference on Artificial Intelligence: methodology, systems, and applications
Local Binary Pattern based features for sign language recognition
Pattern Recognition and Image Analysis
GW'11 Proceedings of the 9th international conference on Gesture and Sign Language in Human-Computer Interaction and Embodied Communication
Tracking benchmark databases for video-based sign language recognition
ECCV'10 Proceedings of the 11th European conference on Trends and Topics in Computer Vision - Volume Part I
Attention Based Detection and Recognition of Hand Postures Against Complex Backgrounds
International Journal of Computer Vision
Finding recurrent patterns from continuous sign language sentences for automated extraction of signs
The Journal of Machine Learning Research
HEGM: A hierarchical elastic graph matching for hand gesture recognition
Pattern Recognition
Visual estimation of pointed targets for robot guidance via fusion of face pose and hand orientation
Computer Vision and Image Understanding
| Hi-index | 0.15 |
Research in automatic analysis of sign language has largely focused on recognizing the lexical (or citation) form of sign gestures as they appear in continuous signing, and developing algorithms that scale well to large vocabularies. However, successful recognition of lexical signs is not sufficient for a full understanding of sign language communication. Nonmanual signals and grammatical processes which result in systematic variations in sign appearance are integral aspects of this communication but have received comparatively little attention in the literature. In this survey, we examine data acquisition, feature extraction and classification methods employed for the analysis of sign language gestures. These are discussed with respect to issues such as modeling transitions between signs in continuous signing, modeling inflectional processes, signer independence, and adaptation. We further examine works that attempt to analyze nonmanual signals and discuss issues related to integrating these with (hand) sign gestures. We also discuss the overall progress toward a true test of sign recognition systems驴dealing with natural signing by native signers. We suggest some future directions for this research and also point to contributions it can make to other fields of research. Web-based supplemental materials (appendicies) which contain several illustrative examples and videos of signing can be found at www.computer.org/publications/dlib.