Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video
IEEE Transactions on Pattern Analysis and Machine Intelligence
ACM Computing Surveys (CSUR)
Extraction of 2D Motion Trajectories and Its Application to Hand Gesture Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Toward Scalability in ASL Recognition: Breaking Down Signs into Phonemes
GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction
Towards an Automatic Sign Language Recognition System Using Subunits
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
A Real-Time Continuous Gesture Recognition System for Sign Language
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
A Novel Approach to Automatically Extracting Basic Units from Chinese Sign Language
ICPR '04 Proceedings of the Pattern Recognition, 17th International Conference on (ICPR'04) Volume 4 - Volume 04
FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
A Unified System for Segmentation and Tracking of Face and Hands in Sign Language Recognition
ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 01
Novel boosting framework for subunit-based sign language recognition
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Human-inspired search for redundancy in automatic sign language recognition
ACM Transactions on Applied Perception (TAP)
ICAISC'10 Proceedings of the 10th international conference on Artifical intelligence and soft computing: Part II
Computers in Biology and Medicine
Modelling and recognition of signed expressions using subunits obtained by data---driven approach
AIMSA'12 Proceedings of the 15th international conference on Artificial Intelligence: methodology, systems, and applications
Thai sign language translation using Scale Invariant Feature Transform and Hidden Markov Models
Pattern Recognition Letters
Sign language recognition using sub-units
The Journal of Machine Learning Research
Finding recurrent patterns from continuous sign language sentences for automated extraction of signs
The Journal of Machine Learning Research
VisualComm: a tool to support communication between deaf and hearing persons with the Kinect
Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility
Hidden Markov Model on a unit hypersphere space for gesture trajectory recognition
Pattern Recognition Letters
Hi-index | 0.10 |
Modelling and segmenting subunits is one of the important topics in sign language study. Many scholars have proposed the functional definition to subunits from the view of linguistics while the problem of efficiently implementing it using computer vision techniques is a challenge. On the other hand, a number of subunit segmentation work has been investigated for the task of vision-based sign language recognition whereas their subunits either somewhat lack the linguistic support or are improper. In this paper, we attempt to define and segment subunits using computer vision techniques, which also can be basically explained by sign language linguistics. A subunit is firstly defined as one continuous visual hand action in time and space, which comprises a series of interrelated consecutive frames. Then, a simple but efficient solution is developed to detect the subunit boundary using hand motion discontinuity. Finally, temporal clustering by dynamic time warping is adopted to merge similar segments and refine the results. The presented work does not need prior knowledge of the types of signs or number of subunits and is more robust to signer behaviour variation. Furthermore, it correlates highly with the definition of syllables in sign language while sharing characteristics of syllables in spoken languages. A set of comprehensive experiments on real-world signing videos demonstrates the effectiveness of the proposed model.